2026-02-19T12:32:31.805 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-19T12:32:31.819 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T12:32:31.897 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58589 branch: wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: null first_in_suite: false flavor: default job_id: '58589' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 2fc421c83f0b86ea21b9e4289cad0f7957e09eb1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: distro-suffix: rockylinux-10 install: ceph: flavor: default sha1: 2fc421c83f0b86ea21b9e4289cad0f7957e09eb1 workunit: branch: wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-suite sha1: 624b9a7bcb2064ce17206482df6a1da007ff7675 owner: scheduled_nmordech@soko04.front.sepia.ceph.com priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 1255 sha1: 2fc421c83f0b86ea21b9e4289cad0f7957e09eb1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-suite suite_path: /home/teuthworker/src/github.com_NitzanMordhai_ceph_624b9a7bcb2064ce17206482df6a1da007ff7675/qa suite_relpath: qa suite_repo: https://github.com/NitzanMordhai/ceph.git suite_sha1: 624b9a7bcb2064ce17206482df6a1da007ff7675 targets: trial109.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHzuwsgiEl6MHI1CzAvDonpHsoMOfSeuB3FsA8YtAemmTM1lmzxKbeyF2BEw6MXtb0rYT2+Q8UP+pjr5toPXv3s= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-19_12:10:46 tube: trial user: nmordech verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-19T12:32:31.897 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_NitzanMordhai_ceph_624b9a7bcb2064ce17206482df6a1da007ff7675/qa; will attempt to use it 2026-02-19T12:32:31.897 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_NitzanMordhai_ceph_624b9a7bcb2064ce17206482df6a1da007ff7675/qa/tasks 2026-02-19T12:32:31.897 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-19T12:32:31.899 INFO:teuthology.task.internal:Checking packages... 2026-02-19T12:32:31.899 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2fc421c83f0b86ea21b9e4289cad0f7957e09eb1' 2026-02-19T12:32:31.899 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-19T12:32:31.899 INFO:teuthology.packaging:ref: None 2026-02-19T12:32:31.899 INFO:teuthology.packaging:tag: None 2026-02-19T12:32:31.899 INFO:teuthology.packaging:branch: wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle 2026-02-19T12:32:31.899 INFO:teuthology.packaging:sha1: 2fc421c83f0b86ea21b9e4289cad0f7957e09eb1 2026-02-19T12:32:31.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle 2026-02-19T12:32:32.016 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-720-g2fc421c8-1jammy 2026-02-19T12:32:32.018 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-19T12:32:32.029 INFO:teuthology.task.internal:no buildpackages task found 2026-02-19T12:32:32.029 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-19T12:32:32.042 INFO:teuthology.task.internal:Saving configuration 2026-02-19T12:32:32.049 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-19T12:32:32.060 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-19T12:32:32.137 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial109.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58589', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-19 12:29:03.156092', 'locked_by': 'scheduled_nmordech@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM6DQH4Um8ihkEqJnL40M/P6/4+uNoHeII4sUYZg5ufz'} 2026-02-19T12:32:32.137 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-19T12:32:32.150 INFO:teuthology.task.internal:roles: ubuntu@trial109.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-19T12:32:32.150 INFO:teuthology.run_tasks:Running task console_log... 2026-02-19T12:32:32.228 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x743d7c4fb560>, signals=[15]) 2026-02-19T12:32:32.228 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-19T12:32:32.239 INFO:teuthology.task.internal:Opening connections... 2026-02-19T12:32:32.239 DEBUG:teuthology.task.internal:connecting to ubuntu@trial109.front.sepia.ceph.com 2026-02-19T12:32:32.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:32:32.304 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-19T12:32:32.315 DEBUG:teuthology.orchestra.run.trial109:> uname -m 2026-02-19T12:32:32.382 INFO:teuthology.orchestra.run.trial109.stdout:x86_64 2026-02-19T12:32:32.382 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-19T12:32:32.425 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:NAME="Ubuntu" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="22.04" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_CODENAME=jammy 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:ID=ubuntu 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE=debian 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-19T12:32:32.426 INFO:teuthology.orchestra.run.trial109.stdout:UBUNTU_CODENAME=jammy 2026-02-19T12:32:32.427 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-19T12:32:32.517 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-19T12:32:32.529 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-19T12:32:32.540 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-19T12:32:32.540 DEBUG:teuthology.orchestra.run.trial109:> test '!' -e /home/ubuntu/cephtest 2026-02-19T12:32:32.543 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-19T12:32:32.553 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-19T12:32:32.553 DEBUG:teuthology.orchestra.run.trial109:> test -z $(ls -A /var/lib/ceph) 2026-02-19T12:32:32.590 INFO:teuthology.orchestra.run.trial109.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-19T12:32:32.590 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-19T12:32:32.687 INFO:teuthology.run_tasks:Running task kernel... 2026-02-19T12:32:32.705 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-19T12:32:32.706 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-19T12:32:32.706 DEBUG:teuthology.orchestra.run.trial109:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-19T12:32:32.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T12:32:32.709 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-19T12:32:32.753 INFO:teuthology.orchestra.run.trial109.stdout:5.15.0-170-generic 2026-02-19T12:32:32.753 INFO:teuthology.task.kernel:Running kernel on trial109: 5.15.0-170-generic 2026-02-19T12:32:32.753 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get clean 2026-02-19T12:32:32.815 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-19T12:32:33.000 INFO:teuthology.orchestra.run.trial109.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-19T12:32:33.008 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-19T12:32:33.046 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-19T12:32:33.062 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-19T12:32:33.140 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3244 kB] 2026-02-19T12:32:33.205 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-19T12:32:33.210 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-19T12:32:33.210 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-19T12:32:33.225 INFO:teuthology.orchestra.run.trial109.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-19T12:32:33.227 INFO:teuthology.orchestra.run.trial109.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-19T12:32:33.230 INFO:teuthology.orchestra.run.trial109.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-19T12:32:33.259 INFO:teuthology.orchestra.run.trial109.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-19T12:32:33.262 INFO:teuthology.orchestra.run.trial109.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-19T12:32:33.271 INFO:teuthology.orchestra.run.trial109.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-19T12:32:33.273 INFO:teuthology.orchestra.run.trial109.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-19T12:32:33.273 INFO:teuthology.orchestra.run.trial109.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-19T12:32:33.295 INFO:teuthology.orchestra.run.trial109.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-19T12:32:37.157 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 21.6 MB in 2s (13.3 MB/s) 2026-02-19T12:32:37.699 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-19T12:32:37.713 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-19T12:32:37.746 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-19T12:32:37.855 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-19T12:32:37.856 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-19T12:32:37.943 INFO:teuthology.orchestra.run.trial109.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-19T12:32:37.943 INFO:teuthology.orchestra.run.trial109.stdout:linux-image-generic set to manually installed. 2026-02-19T12:32:37.943 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-19T12:32:37.944 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-19T12:32:37.944 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-19T12:32:37.944 INFO:teuthology.orchestra.run.trial109.stdout: sg3-utils-udev 2026-02-19T12:32:37.944 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-19T12:32:37.963 INFO:teuthology.orchestra.run.trial109.stdout:0 upgraded, 0 newly installed, 0 to remove and 12 not upgraded. 2026-02-19T12:32:37.965 DEBUG:teuthology.orchestra.run.trial109:> dpkg -s linux-image-generic 2026-02-19T12:32:38.016 INFO:teuthology.orchestra.run.trial109.stdout:Package: linux-image-generic 2026-02-19T12:32:38.016 INFO:teuthology.orchestra.run.trial109.stdout:Status: install ok installed 2026-02-19T12:32:38.016 INFO:teuthology.orchestra.run.trial109.stdout:Priority: optional 2026-02-19T12:32:38.016 INFO:teuthology.orchestra.run.trial109.stdout:Section: kernel 2026-02-19T12:32:38.016 INFO:teuthology.orchestra.run.trial109.stdout:Installed-Size: 21 2026-02-19T12:32:38.016 INFO:teuthology.orchestra.run.trial109.stdout:Maintainer: Ubuntu Kernel Team 2026-02-19T12:32:38.016 INFO:teuthology.orchestra.run.trial109.stdout:Architecture: amd64 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout:Source: linux-meta 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout:Version: 5.15.0.170.159 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout:Recommends: thermald 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout:Description: Generic Linux kernel image 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout: This package will always depend on the latest generic kernel image 2026-02-19T12:32:38.017 INFO:teuthology.orchestra.run.trial109.stdout: available. 2026-02-19T12:32:38.017 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-19T12:32:38.018 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-19T12:32:38.018 DEBUG:teuthology.orchestra.run.trial109:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-19T12:32:38.066 INFO:teuthology.orchestra.run.trial109.stdout:ttyS1 2026-02-19T12:32:38.084 DEBUG:teuthology.parallel:result is None 2026-02-19T12:32:38.085 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-19T12:32:38.097 INFO:teuthology.task.internal:Creating test directory... 2026-02-19T12:32:38.097 DEBUG:teuthology.orchestra.run.trial109:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-19T12:32:38.130 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-19T12:32:38.145 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-19T12:32:38.158 INFO:teuthology.task.internal:Creating archive directory... 2026-02-19T12:32:38.159 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-19T12:32:38.184 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-19T12:32:38.196 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-19T12:32:38.196 DEBUG:teuthology.orchestra.run.trial109:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-19T12:32:38.231 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:32:38.237 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:32:38.238 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-19T12:32:38.251 INFO:teuthology.task.internal:Configuring sudo... 2026-02-19T12:32:38.251 DEBUG:teuthology.orchestra.run.trial109:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-19T12:32:38.290 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-19T12:32:38.307 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-19T12:32:38.307 DEBUG:teuthology.orchestra.run.trial109:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-19T12:32:38.338 DEBUG:teuthology.orchestra.run.trial109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T12:32:38.382 DEBUG:teuthology.orchestra.run.trial109:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T12:32:38.430 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-19T12:32:38.430 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-19T12:32:38.480 DEBUG:teuthology.orchestra.run.trial109:> sudo service rsyslog restart 2026-02-19T12:32:38.539 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-19T12:32:38.551 INFO:teuthology.task.internal:Starting timer... 2026-02-19T12:32:38.552 INFO:teuthology.run_tasks:Running task pcp... 2026-02-19T12:32:38.573 INFO:teuthology.run_tasks:Running task selinux... 2026-02-19T12:32:38.593 DEBUG:teuthology.task.selinux:Excluding trial109: OS 'ubuntu' does not support SELinux 2026-02-19T12:32:38.594 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-19T12:32:38.594 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-19T12:32:38.594 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-19T12:32:38.594 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-19T12:32:38.609 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-19T12:32:38.621 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-19T12:32:38.623 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial109.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-19T12:33:38.979 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial109.front.sepia.ceph.com')] 2026-02-19T12:33:38.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-19T12:33:38.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T12:33:39.064 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-19T12:33:39.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-19T12:33:39.304 INFO:teuthology.run_tasks:Running task clock... 2026-02-19T12:33:39.316 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-19T12:33:39.317 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-19T12:33:39.317 DEBUG:teuthology.orchestra.run.trial109:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T12:33:39.364 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Command line: ntpd -gq 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: ---------------------------------------------------- 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: ntp-4 is maintained by Network Time Foundation, 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: corporation. Support and training for ntp-4 are 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: available at https://www.nwtime.org/support 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: ---------------------------------------------------- 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: proto: precision = 0.020 usec (-25) 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: basedate set to 2022-02-04 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: gps base set to 2022-02-06 (week 2196) 2026-02-19T12:33:39.365 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-19T12:33:39.366 INFO:teuthology.orchestra.run.trial109.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-19T12:33:39.366 INFO:teuthology.orchestra.run.trial109.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-19T12:33:39.367 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: restrict ::: KOD does nothing without LIMITED. 2026-02-19T12:33:39.367 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Listen and drop on 0 v6wildcard [::]:123 2026-02-19T12:33:39.367 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-19T12:33:39.367 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Listen normally on 2 lo 127.0.0.1:123 2026-02-19T12:33:39.367 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Listen normally on 3 enp1s0f0 10.20.193.109:123 2026-02-19T12:33:39.368 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Listen normally on 4 lo [::1]:123 2026-02-19T12:33:39.368 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:61a2%2]:123 2026-02-19T12:33:39.368 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:39 ntpd[5496]: Listening on routing socket on fd #22 for interface updates 2026-02-19T12:33:43.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:43 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:43.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:43 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:43.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:43 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:43.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:43 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:43.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:43 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:43.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:43 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:44.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:44.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:44.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:44.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:44.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:44.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:44.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:44.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:44.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:44.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:44.408 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:44.408 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:44.408 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:44.408 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:44.432 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:44.432 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:44.432 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:44.432 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:44 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:45.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:45 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:45.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:45 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:45.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:45 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:45.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:45 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:45.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:45 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:45.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:45 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:46.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:46.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:46.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:46.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:46.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:46.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:46.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:46.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:46.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:46.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:46.409 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:46.410 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:46.410 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:46.411 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:46.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:46.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:46.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:46.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:46 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:47.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:47 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:47.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:47 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:47.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:47 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:47.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:47 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:47.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:47 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:47.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:47 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:48.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:48.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:48.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:48.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:48.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:48.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:48.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:48.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:48.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:48.367 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:48.407 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:48.407 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:48.407 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:48.407 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:48.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:48.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:48.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:48.433 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:48 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:49.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:49.364 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:49.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T12:33:49.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T12:33:49.435 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T12:33:49.436 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T12:33:49.436 INFO:teuthology.orchestra.run.trial109.stdout:19 Feb 12:33:49 ntpd[5496]: ntpd: time set -0.144315 s 2026-02-19T12:33:49.436 INFO:teuthology.orchestra.run.trial109.stdout:ntpd: time set -0.144315s 2026-02-19T12:33:49.437 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-19T12:33:49.437 INFO:teuthology.orchestra.run.trial109.stderr:19 Feb 12:33:49 ntpd[5496]: can't open /var/log/ntpstats/loopstats.20260219: Permission denied 2026-02-19T12:33:49.459 INFO:teuthology.orchestra.run.trial109.stdout:No association ID's returned 2026-02-19T12:33:49.460 INFO:teuthology.run_tasks:Running task install... 2026-02-19T12:33:49.474 DEBUG:teuthology.task.install:project ceph 2026-02-19T12:33:49.474 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2fc421c83f0b86ea21b9e4289cad0f7957e09eb1'}} 2026-02-19T12:33:49.474 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '2fc421c83f0b86ea21b9e4289cad0f7957e09eb1'} 2026-02-19T12:33:49.474 INFO:teuthology.task.install:Using flavor: default 2026-02-19T12:33:49.483 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-19T12:33:49.483 INFO:teuthology.task.install:extra packages: [] 2026-02-19T12:33:49.484 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-key list | grep Ceph 2026-02-19T12:33:49.548 INFO:teuthology.orchestra.run.trial109.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-19T12:33:49.573 INFO:teuthology.orchestra.run.trial109.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-19T12:33:49.574 INFO:teuthology.orchestra.run.trial109.stdout:uid [ unknown] Ceph.com (release key) 2026-02-19T12:33:49.575 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-19T12:33:49.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2fc421c83f0b86ea21b9e4289cad0f7957e09eb1 2026-02-19T12:33:49.747 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default/ 2026-02-19T12:33:49.747 INFO:teuthology.task.install.deb:Package version is 20.2.0-720-g2fc421c8-1jammy 2026-02-19T12:33:49.884 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-19T12:33:49.884 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-19T12:33:49.894 DEBUG:teuthology.orchestra.run.trial109:> sudo apt-get update 2026-02-19T12:33:50.035 INFO:teuthology.orchestra.run.trial109.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy InRelease 2026-02-19T12:33:50.046 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-19T12:33:50.058 INFO:teuthology.orchestra.run.trial109.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-19T12:33:50.075 INFO:teuthology.orchestra.run.trial109.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-19T12:33:50.075 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.9 kB] 2026-02-19T12:33:50.079 INFO:teuthology.orchestra.run.trial109.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-19T12:33:50.089 INFO:teuthology.orchestra.run.trial109.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-19T12:33:50.099 INFO:teuthology.orchestra.run.trial109.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-19T12:33:50.405 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 26.5 kB in 0s (74.9 kB/s) 2026-02-19T12:33:50.918 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-19T12:33:50.932 DEBUG:teuthology.orchestra.run.trial109:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-720-g2fc421c8-1jammy cephadm=20.2.0-720-g2fc421c8-1jammy ceph-mds=20.2.0-720-g2fc421c8-1jammy ceph-mgr=20.2.0-720-g2fc421c8-1jammy ceph-common=20.2.0-720-g2fc421c8-1jammy ceph-fuse=20.2.0-720-g2fc421c8-1jammy ceph-test=20.2.0-720-g2fc421c8-1jammy ceph-volume=20.2.0-720-g2fc421c8-1jammy radosgw=20.2.0-720-g2fc421c8-1jammy python3-rados=20.2.0-720-g2fc421c8-1jammy python3-rgw=20.2.0-720-g2fc421c8-1jammy python3-cephfs=20.2.0-720-g2fc421c8-1jammy python3-rbd=20.2.0-720-g2fc421c8-1jammy libcephfs2=20.2.0-720-g2fc421c8-1jammy libcephfs-dev=20.2.0-720-g2fc421c8-1jammy librados2=20.2.0-720-g2fc421c8-1jammy librbd1=20.2.0-720-g2fc421c8-1jammy rbd-fuse=20.2.0-720-g2fc421c8-1jammy 2026-02-19T12:33:50.966 INFO:teuthology.orchestra.run.trial109.stdout:Reading package lists... 2026-02-19T12:33:51.076 INFO:teuthology.orchestra.run.trial109.stdout:Building dependency tree... 2026-02-19T12:33:51.076 INFO:teuthology.orchestra.run.trial109.stdout:Reading state information... 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout:The following packages were automatically installed and are no longer required: 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: sg3-utils-udev 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout:The following additional packages will be installed: 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-19T12:33:51.165 INFO:teuthology.orchestra.run.trial109.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: socat xmlstarlet 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout:Suggested packages: 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout:Recommended packages: 2026-02-19T12:33:51.166 INFO:teuthology.orchestra.run.trial109.stdout: btrfs-tools 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout:The following NEW packages will be installed: 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-19T12:33:51.201 INFO:teuthology.orchestra.run.trial109.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-19T12:33:51.202 INFO:teuthology.orchestra.run.trial109.stdout: socat xmlstarlet 2026-02-19T12:33:51.328 INFO:teuthology.orchestra.run.trial109.stdout:0 upgraded, 86 newly installed, 0 to remove and 12 not upgraded. 2026-02-19T12:33:51.328 INFO:teuthology.orchestra.run.trial109.stdout:Need to get 280 MB of archives. 2026-02-19T12:33:51.328 INFO:teuthology.orchestra.run.trial109.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-19T12:33:51.328 INFO:teuthology.orchestra.run.trial109.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-19T12:33:51.375 INFO:teuthology.orchestra.run.trial109.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-19T12:33:51.376 INFO:teuthology.orchestra.run.trial109.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-19T12:33:51.386 INFO:teuthology.orchestra.run.trial109.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-19T12:33:51.415 INFO:teuthology.orchestra.run.trial109.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-19T12:33:51.416 INFO:teuthology.orchestra.run.trial109.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-19T12:33:51.421 INFO:teuthology.orchestra.run.trial109.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-19T12:33:51.424 INFO:teuthology.orchestra.run.trial109.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-19T12:33:51.424 INFO:teuthology.orchestra.run.trial109.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-19T12:33:51.425 INFO:teuthology.orchestra.run.trial109.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-19T12:33:51.425 INFO:teuthology.orchestra.run.trial109.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-19T12:33:51.429 INFO:teuthology.orchestra.run.trial109.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-19T12:33:51.430 INFO:teuthology.orchestra.run.trial109.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-19T12:33:51.430 INFO:teuthology.orchestra.run.trial109.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-19T12:33:51.436 INFO:teuthology.orchestra.run.trial109.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-19T12:33:51.436 INFO:teuthology.orchestra.run.trial109.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-19T12:33:51.436 INFO:teuthology.orchestra.run.trial109.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-19T12:33:51.437 INFO:teuthology.orchestra.run.trial109.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-19T12:33:51.437 INFO:teuthology.orchestra.run.trial109.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-19T12:33:51.445 INFO:teuthology.orchestra.run.trial109.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-19T12:33:51.446 INFO:teuthology.orchestra.run.trial109.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-19T12:33:51.447 INFO:teuthology.orchestra.run.trial109.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-19T12:33:51.448 INFO:teuthology.orchestra.run.trial109.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-19T12:33:51.449 INFO:teuthology.orchestra.run.trial109.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-19T12:33:51.455 INFO:teuthology.orchestra.run.trial109.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-19T12:33:51.456 INFO:teuthology.orchestra.run.trial109.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-19T12:33:51.457 INFO:teuthology.orchestra.run.trial109.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-19T12:33:51.476 INFO:teuthology.orchestra.run.trial109.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-720-g2fc421c8-1jammy [3569 kB] 2026-02-19T12:33:51.480 INFO:teuthology.orchestra.run.trial109.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-19T12:33:51.481 INFO:teuthology.orchestra.run.trial109.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-19T12:33:51.483 INFO:teuthology.orchestra.run.trial109.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-19T12:33:51.501 INFO:teuthology.orchestra.run.trial109.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-19T12:33:51.501 INFO:teuthology.orchestra.run.trial109.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-19T12:33:51.501 INFO:teuthology.orchestra.run.trial109.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-19T12:33:51.502 INFO:teuthology.orchestra.run.trial109.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-19T12:33:51.503 INFO:teuthology.orchestra.run.trial109.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-19T12:33:51.503 INFO:teuthology.orchestra.run.trial109.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-19T12:33:51.507 INFO:teuthology.orchestra.run.trial109.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-19T12:33:51.509 INFO:teuthology.orchestra.run.trial109.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-19T12:33:51.511 INFO:teuthology.orchestra.run.trial109.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-19T12:33:51.511 INFO:teuthology.orchestra.run.trial109.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-19T12:33:51.520 INFO:teuthology.orchestra.run.trial109.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-19T12:33:51.522 INFO:teuthology.orchestra.run.trial109.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-19T12:33:51.526 INFO:teuthology.orchestra.run.trial109.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-19T12:33:51.529 INFO:teuthology.orchestra.run.trial109.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-19T12:33:51.529 INFO:teuthology.orchestra.run.trial109.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-19T12:33:51.530 INFO:teuthology.orchestra.run.trial109.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-19T12:33:51.531 INFO:teuthology.orchestra.run.trial109.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-19T12:33:51.531 INFO:teuthology.orchestra.run.trial109.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-19T12:33:51.537 INFO:teuthology.orchestra.run.trial109.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-19T12:33:51.537 INFO:teuthology.orchestra.run.trial109.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-19T12:33:51.539 INFO:teuthology.orchestra.run.trial109.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-19T12:33:51.539 INFO:teuthology.orchestra.run.trial109.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-19T12:33:51.540 INFO:teuthology.orchestra.run.trial109.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-19T12:33:52.682 INFO:teuthology.orchestra.run.trial109.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-720-g2fc421c8-1jammy [2867 kB] 2026-02-19T12:33:52.859 INFO:teuthology.orchestra.run.trial109.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-720-g2fc421c8-1jammy [833 kB] 2026-02-19T12:33:52.915 INFO:teuthology.orchestra.run.trial109.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-720-g2fc421c8-1jammy [365 kB] 2026-02-19T12:33:52.921 INFO:teuthology.orchestra.run.trial109.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-720-g2fc421c8-1jammy [32.9 kB] 2026-02-19T12:33:52.922 INFO:teuthology.orchestra.run.trial109.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-720-g2fc421c8-1jammy [184 kB] 2026-02-19T12:33:52.925 INFO:teuthology.orchestra.run.trial109.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-720-g2fc421c8-1jammy [84.0 kB] 2026-02-19T12:33:52.929 INFO:teuthology.orchestra.run.trial109.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-720-g2fc421c8-1jammy [341 kB] 2026-02-19T12:33:52.968 INFO:teuthology.orchestra.run.trial109.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-720-g2fc421c8-1jammy [8693 kB] 2026-02-19T12:33:53.338 INFO:teuthology.orchestra.run.trial109.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-720-g2fc421c8-1jammy [112 kB] 2026-02-19T12:33:53.340 INFO:teuthology.orchestra.run.trial109.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-720-g2fc421c8-1jammy [261 kB] 2026-02-19T12:33:53.348 INFO:teuthology.orchestra.run.trial109.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-720-g2fc421c8-1jammy [29.3 MB] 2026-02-19T12:33:54.604 INFO:teuthology.orchestra.run.trial109.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-720-g2fc421c8-1jammy [5416 kB] 2026-02-19T12:33:54.825 INFO:teuthology.orchestra.run.trial109.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-720-g2fc421c8-1jammy [250 kB] 2026-02-19T12:33:54.830 INFO:teuthology.orchestra.run.trial109.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-720-g2fc421c8-1jammy [124 kB] 2026-02-19T12:33:54.833 INFO:teuthology.orchestra.run.trial109.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-720-g2fc421c8-1jammy [911 kB] 2026-02-19T12:33:54.879 INFO:teuthology.orchestra.run.trial109.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-720-g2fc421c8-1jammy [6398 kB] 2026-02-19T12:33:55.156 INFO:teuthology.orchestra.run.trial109.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-720-g2fc421c8-1jammy [21.7 MB] 2026-02-19T12:33:56.080 INFO:teuthology.orchestra.run.trial109.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-720-g2fc421c8-1jammy [14.1 kB] 2026-02-19T12:33:56.080 INFO:teuthology.orchestra.run.trial109.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-720-g2fc421c8-1jammy [957 kB] 2026-02-19T12:33:56.103 INFO:teuthology.orchestra.run.trial109.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-720-g2fc421c8-1jammy [2344 kB] 2026-02-19T12:33:56.223 INFO:teuthology.orchestra.run.trial109.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-720-g2fc421c8-1jammy [1049 kB] 2026-02-19T12:33:56.269 INFO:teuthology.orchestra.run.trial109.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-720-g2fc421c8-1jammy [179 kB] 2026-02-19T12:33:56.272 INFO:teuthology.orchestra.run.trial109.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-720-g2fc421c8-1jammy [45.5 MB] 2026-02-19T12:33:58.220 INFO:teuthology.orchestra.run.trial109.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-720-g2fc421c8-1jammy [8626 kB] 2026-02-19T12:33:58.586 INFO:teuthology.orchestra.run.trial109.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-720-g2fc421c8-1jammy [14.2 kB] 2026-02-19T12:33:58.586 INFO:teuthology.orchestra.run.trial109.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-720-g2fc421c8-1jammy [99.5 MB] 2026-02-19T12:34:01.510 INFO:teuthology.orchestra.run.trial109.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-720-g2fc421c8-1jammy [135 kB] 2026-02-19T12:34:01.510 INFO:teuthology.orchestra.run.trial109.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-720-g2fc421c8-1jammy [43.2 kB] 2026-02-19T12:34:01.511 INFO:teuthology.orchestra.run.trial109.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-720-g2fc421c8-1jammy [30.7 kB] 2026-02-19T12:34:01.511 INFO:teuthology.orchestra.run.trial109.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-720-g2fc421c8-1jammy [41.5 kB] 2026-02-19T12:34:01.522 INFO:teuthology.orchestra.run.trial109.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-720-g2fc421c8-1jammy [25.1 MB] 2026-02-19T12:34:02.210 INFO:teuthology.orchestra.run.trial109.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle/2fc421c83f0b86ea21b9e4289cad0f7957e09eb1/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-720-g2fc421c8-1jammy [97.5 kB] 2026-02-19T12:34:02.490 INFO:teuthology.orchestra.run.trial109.stdout:Fetched 280 MB in 11s (25.4 MB/s) 2026-02-19T12:34:02.510 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-19T12:34:02.665 INFO:teuthology.orchestra.run.trial109.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-19T12:34:02.667 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-19T12:34:02.668 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-19T12:34:02.689 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-19T12:34:02.701 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-19T12:34:02.702 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-19T12:34:02.716 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-19T12:34:02.728 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-19T12:34:02.729 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-19T12:34:02.748 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-19T12:34:02.756 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-19T12:34:02.761 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T12:34:02.791 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-19T12:34:02.799 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-19T12:34:02.799 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T12:34:02.815 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-19T12:34:02.823 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-19T12:34:02.824 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T12:34:02.845 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-19T12:34:02.853 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-19T12:34:02.853 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-19T12:34:02.869 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librados2. 2026-02-19T12:34:02.877 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../07-librados2_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:02.877 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librados2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:02.919 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libnbd0. 2026-02-19T12:34:02.927 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-19T12:34:02.928 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-19T12:34:02.942 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librbd1. 2026-02-19T12:34:02.950 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../09-librbd1_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:02.951 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librbd1 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:02.988 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs2. 2026-02-19T12:34:02.996 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:02.996 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.015 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rados. 2026-02-19T12:34:03.023 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../11-python3-rados_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.024 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rados (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.040 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-19T12:34:03.048 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:03.049 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-ceph-argparse (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.063 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cephfs. 2026-02-19T12:34:03.070 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.071 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cephfs (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.087 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-19T12:34:03.095 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:03.095 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-ceph-common (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.113 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-19T12:34:03.121 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-19T12:34:03.121 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-19T12:34:03.137 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-prettytable. 2026-02-19T12:34:03.145 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-19T12:34:03.145 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-19T12:34:03.159 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rbd. 2026-02-19T12:34:03.167 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.167 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rbd (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.184 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-19T12:34:03.192 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-19T12:34:03.193 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-19T12:34:03.211 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package librgw2. 2026-02-19T12:34:03.219 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../19-librgw2_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.219 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking librgw2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.317 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rgw. 2026-02-19T12:34:03.325 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.325 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rgw (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.341 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-19T12:34:03.349 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-19T12:34:03.349 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-19T12:34:03.364 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libradosstriper1. 2026-02-19T12:34:03.372 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.372 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libradosstriper1 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.389 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-common. 2026-02-19T12:34:03.397 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../23-ceph-common_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.397 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-common (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.643 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-base. 2026-02-19T12:34:03.651 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../24-ceph-base_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:03.656 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-base (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:03.720 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-19T12:34:03.728 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-19T12:34:03.728 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-19T12:34:03.743 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cheroot. 2026-02-19T12:34:03.751 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-19T12:34:03.751 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-19T12:34:03.768 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-19T12:34:03.776 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-19T12:34:03.777 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-19T12:34:03.791 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-19T12:34:03.799 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-19T12:34:03.800 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-19T12:34:03.814 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-19T12:34:03.822 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-19T12:34:03.823 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-19T12:34:03.836 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-tempora. 2026-02-19T12:34:03.845 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-19T12:34:03.845 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-19T12:34:03.860 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-portend. 2026-02-19T12:34:03.869 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-19T12:34:03.869 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-19T12:34:03.883 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-19T12:34:03.891 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-19T12:34:03.892 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-19T12:34:03.907 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-19T12:34:03.915 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-19T12:34:03.916 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-19T12:34:03.939 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-natsort. 2026-02-19T12:34:03.947 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-19T12:34:03.948 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-19T12:34:03.963 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-19T12:34:03.971 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:03.971 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-modules-core (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.000 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-19T12:34:04.008 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.008 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.023 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr. 2026-02-19T12:34:04.031 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.031 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.052 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mon. 2026-02-19T12:34:04.060 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.061 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mon (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.117 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-19T12:34:04.125 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-19T12:34:04.126 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-19T12:34:04.142 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-osd. 2026-02-19T12:34:04.150 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.150 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-osd (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.298 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph. 2026-02-19T12:34:04.307 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../41-ceph_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.307 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.320 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-fuse. 2026-02-19T12:34:04.328 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.328 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-fuse (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.350 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mds. 2026-02-19T12:34:04.359 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.359 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mds (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.397 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package cephadm. 2026-02-19T12:34:04.406 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../44-cephadm_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:04.406 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking cephadm (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.421 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-19T12:34:04.429 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-19T12:34:04.430 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-19T12:34:04.451 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-19T12:34:04.459 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:04.459 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-cephadm (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.480 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-19T12:34:04.488 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-19T12:34:04.488 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-19T12:34:04.503 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-routes. 2026-02-19T12:34:04.512 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-19T12:34:04.512 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-19T12:34:04.532 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-19T12:34:04.540 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:04.541 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-dashboard (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:04.976 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-19T12:34:04.986 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-19T12:34:04.986 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-19T12:34:05.024 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-joblib. 2026-02-19T12:34:05.032 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-19T12:34:05.033 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-19T12:34:05.059 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-19T12:34:05.069 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-19T12:34:05.069 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-19T12:34:05.083 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-sklearn. 2026-02-19T12:34:05.091 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-19T12:34:05.092 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-19T12:34:05.176 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-19T12:34:05.186 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:05.186 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:05.340 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-cachetools. 2026-02-19T12:34:05.348 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-19T12:34:05.348 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-19T12:34:05.363 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-rsa. 2026-02-19T12:34:05.372 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-19T12:34:05.372 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-19T12:34:05.390 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-google-auth. 2026-02-19T12:34:05.399 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-19T12:34:05.399 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-19T12:34:05.416 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-19T12:34:05.424 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-19T12:34:05.424 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-19T12:34:05.440 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-websocket. 2026-02-19T12:34:05.448 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-19T12:34:05.448 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-19T12:34:05.466 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-19T12:34:05.474 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-19T12:34:05.475 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-19T12:34:05.567 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-19T12:34:05.576 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:05.576 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:05.589 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-19T12:34:05.597 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-19T12:34:05.598 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-19T12:34:05.613 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-19T12:34:05.621 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-19T12:34:05.621 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-19T12:34:05.635 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package jq. 2026-02-19T12:34:05.643 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-19T12:34:05.644 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-19T12:34:05.658 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package socat. 2026-02-19T12:34:05.666 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-19T12:34:05.666 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-19T12:34:05.685 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package xmlstarlet. 2026-02-19T12:34:05.693 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-19T12:34:05.694 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-19T12:34:05.730 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-test. 2026-02-19T12:34:05.738 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../67-ceph-test_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:05.738 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-test (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:06.615 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package ceph-volume. 2026-02-19T12:34:06.623 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-720-g2fc421c8-1jammy_all.deb ... 2026-02-19T12:34:06.624 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking ceph-volume (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:06.647 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-19T12:34:06.656 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:06.656 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs-daemon (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:06.671 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-19T12:34:06.679 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:06.680 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs-proxy2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:06.695 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-19T12:34:06.703 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:06.703 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking libcephfs-dev (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:06.719 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package nvme-cli. 2026-02-19T12:34:06.727 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-19T12:34:06.728 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-19T12:34:06.759 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-19T12:34:06.767 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-19T12:34:06.768 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-19T12:34:06.797 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-19T12:34:06.805 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-19T12:34:06.806 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-19T12:34:06.821 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pluggy. 2026-02-19T12:34:06.829 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-19T12:34:06.830 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-19T12:34:06.844 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-psutil. 2026-02-19T12:34:06.853 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-19T12:34:06.853 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-19T12:34:06.871 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-py. 2026-02-19T12:34:06.880 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-19T12:34:06.880 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-19T12:34:06.899 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pygments. 2026-02-19T12:34:06.908 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-19T12:34:06.908 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-19T12:34:06.949 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-toml. 2026-02-19T12:34:06.957 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-19T12:34:06.958 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-19T12:34:06.973 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-pytest. 2026-02-19T12:34:06.982 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-19T12:34:06.982 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-19T12:34:07.004 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-simplejson. 2026-02-19T12:34:07.012 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-19T12:34:07.013 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-19T12:34:07.030 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package python3-webob. 2026-02-19T12:34:07.038 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-19T12:34:07.039 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-19T12:34:07.062 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-19T12:34:07.071 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-19T12:34:07.071 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-19T12:34:07.140 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package radosgw. 2026-02-19T12:34:07.149 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../84-radosgw_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:07.149 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking radosgw (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:07.354 INFO:teuthology.orchestra.run.trial109.stdout:Selecting previously unselected package rbd-fuse. 2026-02-19T12:34:07.363 INFO:teuthology.orchestra.run.trial109.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-720-g2fc421c8-1jammy_amd64.deb ... 2026-02-19T12:34:07.363 INFO:teuthology.orchestra.run.trial109.stdout:Unpacking rbd-fuse (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:07.391 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-19T12:34:07.457 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-19T12:34:07.458 INFO:teuthology.orchestra.run.trial109.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-19T12:34:07.531 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-19T12:34:07.807 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-19T12:34:08.183 INFO:teuthology.orchestra.run.trial109.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-19T12:34:08.193 INFO:teuthology.orchestra.run.trial109.stdout:Setting up cephadm (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:08.238 INFO:teuthology.orchestra.run.trial109.stdout:Adding system user cephadm....done 2026-02-19T12:34:08.247 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-19T12:34:08.319 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-19T12:34:08.320 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-19T12:34:08.391 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-19T12:34:08.467 INFO:teuthology.orchestra.run.trial109.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-19T12:34:08.467 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-19T12:34:08.561 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-19T12:34:08.686 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-19T12:34:08.762 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-19T12:34:08.836 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-ceph-argparse (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:08.901 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-19T12:34:08.902 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-19T12:34:08.903 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-19T12:34:08.904 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-19T12:34:08.905 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-19T12:34:09.028 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-19T12:34:09.105 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs-proxy2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:09.106 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-19T12:34:09.182 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-19T12:34:09.271 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-19T12:34:09.518 INFO:teuthology.orchestra.run.trial109.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-19T12:34:09.519 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-19T12:34:09.613 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-19T12:34:09.738 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-19T12:34:09.820 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-19T12:34:09.891 INFO:teuthology.orchestra.run.trial109.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-19T12:34:09.892 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-ceph-common (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:09.979 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-19T12:34:10.468 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T12:34:10.473 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-19T12:34:10.547 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-19T12:34:10.548 INFO:teuthology.orchestra.run.trial109.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-19T12:34:10.549 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-19T12:34:10.622 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-19T12:34:10.695 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T12:34:10.696 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-19T12:34:10.773 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-19T12:34:10.845 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-19T12:34:10.925 INFO:teuthology.orchestra.run.trial109.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-19T12:34:10.925 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-19T12:34:11.010 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-19T12:34:11.010 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-19T12:34:11.087 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-19T12:34:11.172 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-19T12:34:11.244 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-19T12:34:11.245 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-19T12:34:11.376 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-19T12:34:11.446 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T12:34:11.447 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-19T12:34:11.528 INFO:teuthology.orchestra.run.trial109.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-19T12:34:11.529 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-19T12:34:11.656 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-19T12:34:11.657 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librados2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:11.658 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librgw2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:11.659 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libsqlite3-mod-ceph (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:11.660 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-19T12:34:12.172 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs2 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.173 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libradosstriper1 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.174 INFO:teuthology.orchestra.run.trial109.stdout:Setting up librbd1 (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.175 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-modules-core (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.176 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-fuse (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.248 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-19T12:34:12.248 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-19T12:34:12.621 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs-dev (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.621 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rados (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.622 INFO:teuthology.orchestra.run.trial109.stdout:Setting up libcephfs-daemon (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.623 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rbd (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.624 INFO:teuthology.orchestra.run.trial109.stdout:Setting up rbd-fuse (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.625 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-rgw (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.626 INFO:teuthology.orchestra.run.trial109.stdout:Setting up python3-cephfs (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.627 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-common (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:12.655 INFO:teuthology.orchestra.run.trial109.stdout:Adding group ceph....done 2026-02-19T12:34:12.691 INFO:teuthology.orchestra.run.trial109.stdout:Adding system user ceph....done 2026-02-19T12:34:12.701 INFO:teuthology.orchestra.run.trial109.stdout:Setting system user ceph properties....done 2026-02-19T12:34:12.708 INFO:teuthology.orchestra.run.trial109.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-19T12:34:12.795 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-19T12:34:13.065 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-19T12:34:13.454 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-test (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:13.455 INFO:teuthology.orchestra.run.trial109.stdout:Setting up radosgw (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:13.698 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-19T12:34:13.698 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-19T12:34:14.052 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-base (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:14.169 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-19T12:34:14.549 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mds (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:14.609 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-19T12:34:14.609 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-19T12:34:14.933 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:15.005 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-19T12:34:15.005 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-19T12:34:15.392 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-osd (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:15.480 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-19T12:34:15.480 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-19T12:34:15.859 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-k8sevents (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:15.869 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:15.879 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mon (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:15.952 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-19T12:34:15.952 INFO:teuthology.orchestra.run.trial109.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-19T12:34:16.328 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-cephadm (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:16.338 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:16.339 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-mgr-dashboard (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:16.350 INFO:teuthology.orchestra.run.trial109.stdout:Setting up ceph-volume (20.2.0-720-g2fc421c8-1jammy) ... 2026-02-19T12:34:16.457 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-19T12:34:16.538 INFO:teuthology.orchestra.run.trial109.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout:Running kernel seems to be up-to-date. 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout:The processor microcode seems to be up-to-date. 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout:No services need to be restarted. 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout:No containers need to be restarted. 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-19T12:34:17.188 INFO:teuthology.orchestra.run.trial109.stdout:No user sessions are running outdated binaries. 2026-02-19T12:34:17.189 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-19T12:34:17.189 INFO:teuthology.orchestra.run.trial109.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-19T12:34:17.971 INFO:teuthology.orchestra.run.trial109.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-19T12:34:17.977 DEBUG:teuthology.parallel:result is None 2026-02-19T12:34:17.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2fc421c83f0b86ea21b9e4289cad0f7957e09eb1 2026-02-19T12:34:18.145 DEBUG:teuthology.orchestra.run.trial109:> dpkg-query -W -f '${Version}' ceph 2026-02-19T12:34:18.157 INFO:teuthology.orchestra.run.trial109.stdout:20.2.0-720-g2fc421c8-1jammy 2026-02-19T12:34:18.157 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-720-g2fc421c8-1jammy 2026-02-19T12:34:18.157 INFO:teuthology.task.install:The correct ceph version 20.2.0-720-g2fc421c8-1jammy is installed. 2026-02-19T12:34:18.160 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-19T12:34:18.160 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-19T12:34:18.160 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-19T12:34:18.207 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-19T12:34:18.207 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-19T12:34:18.207 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/daemon-helper 2026-02-19T12:34:18.262 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-19T12:34:18.310 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-19T12:34:18.310 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-19T12:34:18.310 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-19T12:34:18.358 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-19T12:34:18.406 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-19T12:34:18.406 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-19T12:34:18.406 DEBUG:teuthology.orchestra.run.trial109:> sudo dd of=/usr/bin/stdin-killer 2026-02-19T12:34:18.453 DEBUG:teuthology.orchestra.run.trial109:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-19T12:34:18.501 INFO:teuthology.run_tasks:Running task workunit... 2026-02-19T12:34:18.523 INFO:tasks.workunit:Pulling workunits from ref 624b9a7bcb2064ce17206482df6a1da007ff7675 2026-02-19T12:34:18.523 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-19T12:34:18.524 INFO:tasks.workunit:timeout=3h 2026-02-19T12:34:18.524 INFO:tasks.workunit:cleanup=True 2026-02-19T12:34:18.524 DEBUG:teuthology.orchestra.run.trial109:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-19T12:34:18.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T12:34:18.546 INFO:teuthology.orchestra.run.trial109.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-19T12:34:18.546 DEBUG:teuthology.orchestra.run.trial109:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-19T12:34:18.594 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-19T12:34:18.594 DEBUG:teuthology.orchestra.run.trial109:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-19T12:34:18.638 DEBUG:teuthology.orchestra.run.trial109:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/NitzanMordhai/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 624b9a7bcb2064ce17206482df6a1da007ff7675 2026-02-19T12:34:18.688 INFO:tasks.workunit.client.0.trial109.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-19T12:34:43.365 INFO:tasks.workunit.client.0.trial109.stderr:Note: switching to '624b9a7bcb2064ce17206482df6a1da007ff7675'. 2026-02-19T12:34:43.365 INFO:tasks.workunit.client.0.trial109.stderr: 2026-02-19T12:34:43.365 INFO:tasks.workunit.client.0.trial109.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-19T12:34:43.365 INFO:tasks.workunit.client.0.trial109.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr:state without impacting any branches by switching back to a branch. 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr: 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr: 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr: git switch -c 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr: 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr:Or undo this operation with: 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr: 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr: git switch - 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr: 2026-02-19T12:34:43.366 INFO:tasks.workunit.client.0.trial109.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-19T12:34:43.367 INFO:tasks.workunit.client.0.trial109.stderr: 2026-02-19T12:34:43.367 INFO:tasks.workunit.client.0.trial109.stderr:HEAD is now at 624b9a7bcb2 Integration branch metadata 2026-02-19T12:34:43.373 DEBUG:teuthology.orchestra.run.trial109:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-19T12:34:43.420 DEBUG:teuthology.orchestra.run.trial109:> set -ex 2026-02-19T12:34:43.420 DEBUG:teuthology.orchestra.run.trial109:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-19T12:34:43.466 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-19T12:34:43.467 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-19T12:34:43.468 DEBUG:teuthology.orchestra.run.trial109:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=624b9a7bcb2064ce17206482df6a1da007ff7675 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-19T12:34:43.520 INFO:tasks.workunit.client.0.trial109.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T12:34:43.535 INFO:tasks.workunit.client.0.trial109.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T12:34:43.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/bad-inc-map 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-19T12:34:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:58861 2026-02-19T12:34:43.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:58861 2026-02-19T12:34:43.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-19T12:34:43.537 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-19T12:34:43.538 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none ' 2026-02-19T12:34:43.538 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:58861 ' 2026-02-19T12:34:43.538 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-19T12:34:43.538 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-19T12:34:43.538 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T12:34:43.539 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:34:43.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:34:43.541 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:34:43.541 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:34:43.542 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:34:43.543 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:34:43.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:34:43.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:34:43.544 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:34:43.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:34:43.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:34:43.546 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:34:43.546 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:34:43.547 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:34:43.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:34:43.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-19T12:34:43.549 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:34:43.549 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:43.549 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:43.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.8141 2026-02-19T12:34:43.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:34:43.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:34:43.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-19T12:34:43.552 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:34:43.552 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:43.552 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:43.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.8141 2026-02-19T12:34:43.553 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-19T12:34:43.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:34:43.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:34:43.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:34:43.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-19T12:34:43.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-19T12:34:43.588 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:34:43.588 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:34:43.588 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:34:43.588 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:34:43.588 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:43.588 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:43.589 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:43.589 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:34:43.618 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:34:43.619 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:34:43.619 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:34:43.619 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:34:43.619 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:34:43.619 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:34:43.620 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:34:43.620 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:34:43.620 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:34:43.620 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:34:43.620 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:43.621 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:43.621 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.8141/ceph-mon.a.asok 2026-02-19T12:34:43.621 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:34:43.621 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.8141/ceph-mon.a.asok config get fsid 2026-02-19T12:34:43.675 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:34:43.675 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:34:43.675 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:34:43.675 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.8141/ceph-mon.a.asok 2026-02-19T12:34:43.676 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:34:43.677 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.8141/ceph-mon.a.asok config get mon_host 2026-02-19T12:34:43.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-19T12:34:43.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-19T12:34:43.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:34:43.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:34:43.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:34:43.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-19T12:34:43.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:34:43.836 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:34:43.836 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:34:43.836 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:34:43.836 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:34:43.836 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:43.836 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:43.836 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:43.837 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:34:43.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:34:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-19T12:34:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-19T12:34:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:34:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:34:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:34:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 ' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:34:43.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:34:43.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:34:43.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:34:43.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:34:43.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:34:43.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-19T12:34:43.863 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:34:43.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f65f9531-9f9b-4d26-9455-53c607ddd1ee 2026-02-19T12:34:43.864 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 f65f9531-9f9b-4d26-9455-53c607ddd1ee' 2026-02-19T12:34:43.864 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 f65f9531-9f9b-4d26-9455-53c607ddd1ee 2026-02-19T12:34:43.864 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:34:43.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBjA5dp2XjJMxAAiyNzYFpzSm06Gj23wMp6mA== 2026-02-19T12:34:43.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBjA5dp2XjJMxAAiyNzYFpzSm06Gj23wMp6mA=="}' 2026-02-19T12:34:43.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f65f9531-9f9b-4d26-9455-53c607ddd1ee -i td/bad-inc-map/0/new.json 2026-02-19T12:34:43.984 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:34:43.992 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-19T12:34:43.993 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBjA5dp2XjJMxAAiyNzYFpzSm06Gj23wMp6mA== --osd-uuid f65f9531-9f9b-4d26-9455-53c607ddd1ee 2026-02-19T12:34:44.009 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:44.004+0000 7f8dc5ea9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:44.010 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:44.008+0000 7f8dc5ea9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:44.011 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:44.008+0000 7f8dc5ea9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:44.012 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:44.008+0000 7f8dc5ea9a40 -1 bdev(0x555980192c00 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:34:44.012 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:44.008+0000 7f8dc5ea9a40 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-19T12:34:44.878 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-19T12:34:44.879 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:34:44.879 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:34:44.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:34:44.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:34:45.164 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:34:45.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:34:45.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:34:45.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:34:45.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:34:45.166 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:34:45.187 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:45.184+0000 7f8a87b98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:45.188 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:45.184+0000 7f8a87b98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:45.189 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:45.184+0000 7f8a87b98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:45.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:34:45.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:34:45.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:34:45.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:34:45.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:34:45.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:34:45.379 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:34:45.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:34:45.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:45.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:34:45.539 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:45.536+0000 7f8a87b98a40 -1 Falling back to public interface 2026-02-19T12:34:45.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:34:46.124 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:46.120+0000 7f8a87b98a40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:34:46.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:34:46.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:34:46.596 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:34:46.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:34:46.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:46.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:34:46.805 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3009923572,v1:127.0.0.1:6803/3009923572] [v2:127.0.0.1:6804/3009923572,v1:127.0.0.1:6805/3009923572] exists,up f65f9531-9f9b-4d26-9455-53c607ddd1ee 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 ' 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:34:46.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-19T12:34:46.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-19T12:34:46.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:34:46.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:34:46.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:34:46.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:34:46.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:34:46.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:34:46.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-19T12:34:46.809 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:34:46.810 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1e73298b-3bbb-47d9-9114-a0fd2a118508 2026-02-19T12:34:46.810 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 1e73298b-3bbb-47d9-9114-a0fd2a118508' 2026-02-19T12:34:46.810 INFO:tasks.workunit.client.0.trial109.stdout:add osd1 1e73298b-3bbb-47d9-9114-a0fd2a118508 2026-02-19T12:34:46.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:34:46.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBmA5dplMnjMBAAruXpdThNQkzJWx0MyBYS3w== 2026-02-19T12:34:46.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBmA5dplMnjMBAAruXpdThNQkzJWx0MyBYS3w=="}' 2026-02-19T12:34:46.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1e73298b-3bbb-47d9-9114-a0fd2a118508 -i td/bad-inc-map/1/new.json 2026-02-19T12:34:47.035 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:34:47.045 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-19T12:34:47.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBmA5dplMnjMBAAruXpdThNQkzJWx0MyBYS3w== --osd-uuid 1e73298b-3bbb-47d9-9114-a0fd2a118508 2026-02-19T12:34:47.070 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:47.064+0000 7fc4d5a46a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:47.072 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:47.068+0000 7fc4d5a46a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:47.073 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:47.068+0000 7fc4d5a46a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:47.073 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:47.068+0000 7fc4d5a46a40 -1 bdev(0x560daba10c00 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-19T12:34:47.073 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:47.068+0000 7fc4d5a46a40 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-19T12:34:47.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-19T12:34:47.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:34:47.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T12:34:47.747 INFO:tasks.workunit.client.0.trial109.stdout:adding osd1 key to auth repository 2026-02-19T12:34:47.747 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:34:48.039 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:34:48.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T12:34:48.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:34:48.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:34:48.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:34:48.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:34:48.055 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:48.052+0000 7f6395bf6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:48.056 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:48.052+0000 7f6395bf6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:48.057 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:48.052+0000 7f6395bf6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:48.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T12:34:48.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:34:48.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:34:48.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:34:48.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:34:48.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:34:48.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:34:48.248 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:34:48.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:48.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:34:48.458 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:34:48.503 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:48.500+0000 7f6395bf6a40 -1 Falling back to public interface 2026-02-19T12:34:49.080 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:49.076+0000 7f6395bf6a40 -1 osd.1 0 log_to_monitors true 2026-02-19T12:34:49.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:34:49.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:34:49.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:34:49.461 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:34:49.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:49.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:34:49.685 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/71583934,v1:127.0.0.1:6811/71583934] [v2:127.0.0.1:6812/71583934,v1:127.0.0.1:6813/71583934] exists,up 1e73298b-3bbb-47d9-9114-a0fd2a118508 2026-02-19T12:34:49.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:34:49.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 ' 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:34:49.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:34:49.690 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:34:49.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-19T12:34:49.692 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:34:49.692 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=43cd60a4-4bf3-4414-867a-60be34062af3 2026-02-19T12:34:49.692 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 43cd60a4-4bf3-4414-867a-60be34062af3' 2026-02-19T12:34:49.693 INFO:tasks.workunit.client.0.trial109.stdout:add osd2 43cd60a4-4bf3-4414-867a-60be34062af3 2026-02-19T12:34:49.693 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:34:49.701 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBpA5dpLoCiKRAA7EYW8Uqe/R72RipaWqrGMg== 2026-02-19T12:34:49.701 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBpA5dpLoCiKRAA7EYW8Uqe/R72RipaWqrGMg=="}' 2026-02-19T12:34:49.701 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 43cd60a4-4bf3-4414-867a-60be34062af3 -i td/bad-inc-map/2/new.json 2026-02-19T12:34:49.917 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:34:49.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-19T12:34:49.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBpA5dpLoCiKRAA7EYW8Uqe/R72RipaWqrGMg== --osd-uuid 43cd60a4-4bf3-4414-867a-60be34062af3 2026-02-19T12:34:49.942 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:49.940+0000 7faf32de9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:49.944 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:49.940+0000 7faf32de9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:49.944 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:49.940+0000 7faf32de9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:49.945 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:49.940+0000 7faf32de9a40 -1 bdev(0x5635f29bcc00 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-19T12:34:49.945 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:49.940+0000 7faf32de9a40 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-19T12:34:50.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-19T12:34:50.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:34:50.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T12:34:50.695 INFO:tasks.workunit.client.0.trial109.stdout:adding osd2 key to auth repository 2026-02-19T12:34:50.695 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:34:50.979 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:34:50.980 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T12:34:50.980 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=53c483e1-e62a-4bb2-bbb1-f4bdc679ffd9 --auth-supported=none --mon-host=127.0.0.1:58861 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.8141/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:34:50.980 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:34:50.981 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:34:50.981 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:34:50.993 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:50.988+0000 7fc95e428a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:50.994 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:50.992+0000 7fc95e428a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:50.995 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:50.992+0000 7fc95e428a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:34:51.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T12:34:51.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:34:51.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:34:51.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:34:51.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:34:51.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:34:51.198 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:34:51.198 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:34:51.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:51.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:34:51.296 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:51.292+0000 7fc95e428a40 -1 Falling back to public interface 2026-02-19T12:34:51.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:34:51.857 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:34:51.852+0000 7fc95e428a40 -1 osd.2 0 log_to_monitors true 2026-02-19T12:34:52.403 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:34:52.404 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:34:52.404 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:34:52.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:34:52.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:52.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:34:52.607 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/839834818,v1:127.0.0.1:6819/839834818] [v2:127.0.0.1:6820/839834818,v1:127.0.0.1:6821/839834818] exists,up 43cd60a4-4bf3-4414-867a-60be34062af3 2026-02-19T12:34:52.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:34:52.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:34:52.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:34:52.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-19T12:34:52.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-19T12:34:52.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-19T12:34:53.107 INFO:tasks.workunit.client.0.trial109.stderr:pool 'foo' already exists 2026-02-19T12:34:53.116 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:34:54.118 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-19T12:34:54.383 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 min_size to 1 2026-02-19T12:34:54.395 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-19T12:34:54.690 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 min_size to 2 2026-02-19T12:34:54.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:59.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:34:59.916 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3009923572,v1:127.0.0.1:6803/3009923572] [v2:127.0.0.1:6804/3009923572,v1:127.0.0.1:6805/3009923572] exists,up f65f9531-9f9b-4d26-9455-53c607ddd1ee 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:34:59.917 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:34:59.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:34:59.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:35:00.125 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/71583934,v1:127.0.0.1:6811/71583934] [v2:127.0.0.1:6812/71583934,v1:127.0.0.1:6813/71583934] exists,up 1e73298b-3bbb-47d9-9114-a0fd2a118508 2026-02-19T12:35:00.126 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:35:00.126 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:35:00.126 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:35:00.126 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-19T12:35:00.126 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-19T12:35:00.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:35:00.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:35:00.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:35:00.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:35:00.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-19T12:35:00.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:35:00.127 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:35:00.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:00.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:35:00.333 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 13 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/839834818,v1:127.0.0.1:6819/839834818] [v2:127.0.0.1:6820/839834818,v1:127.0.0.1:6821/839834818] exists,up 43cd60a4-4bf3-4414-867a-60be34062af3 2026-02-19T12:35:00.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:35:00.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:35:00.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:35:00.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-19T12:35:00.335 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:53.156+0000 7fc94d264640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:53.260+0000 7fc94d264640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.176+0000 7fc94d264640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.280+0000 7fc94b260640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.380+0000 7fc94d264640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.380+0000 7fc94d264640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.584+0000 7fc94b260640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.688+0000 7fc94d264640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.336 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.688+0000 7fc94b260640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-19T12:35:00.337 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-19T12:35:00.337 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:53.156+0000 7fc94d264640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-19T12:35:00.337 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:53.260+0000 7fc94d264640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-19T12:35:00.337 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.176+0000 7fc94d264640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-19T12:35:00.338 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.280+0000 7fc94b260640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-19T12:35:00.338 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.380+0000 7fc94d264640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-19T12:35:00.338 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.380+0000 7fc94d264640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-19T12:35:00.338 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.584+0000 7fc94b260640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-19T12:35:00.338 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.688+0000 7fc94d264640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-19T12:35:00.338 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:34:54.688+0000 7fc94b260640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-19T12:35:00.338 INFO:tasks.workunit.client.0.trial109.stdout:success 2026-02-19T12:35:00.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-19T12:35:00.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-19T12:35:00.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-19T12:35:00.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-19T12:35:00.563 INFO:tasks.workunit.client.0.trial109.stderr:pool 'foo' does not exist 2026-02-19T12:35:00.574 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-19T12:35:00.575 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:35:00.575 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:35:00.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:35:00.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:35:00.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:35:05.890 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:35:05.890 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-19T12:35:05.890 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-19T12:35:05.891 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:35:05.891 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-19T12:35:05.891 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:35:05.891 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:35:05.891 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:35:05.892 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:35:05.892 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:35:05.897 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:35:05.897 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:35:05.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:35:05.899 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:35:05.900 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:35:05.900 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:35:05.901 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:35:05.901 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:35:05.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:35:05.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:35:05.902 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:35:05.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:35:05.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:35:05.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-19T12:35:05.914 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:35:05.914 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:05.914 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:35:05.914 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.8141 2026-02-19T12:35:05.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:35:05.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:35:05.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-19T12:35:05.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/bad-inc-map 0 2026-02-19T12:35:05.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-19T12:35:05.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T12:35:05.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-19T12:35:05.917 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:35:05.917 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:35:05.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:35:05.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:35:05.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:35:05.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:35:05.918 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:35:05.919 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:35:05.919 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:35:05.920 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:35:05.920 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:35:05.921 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:35:05.921 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:35:05.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:35:05.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:35:05.922 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:35:05.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:35:05.924 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T12:35:05.924 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-19T12:35:05.925 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:35:05.925 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:05.925 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.8141 2026-02-19T12:35:05.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.8141 2026-02-19T12:35:05.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:35:05.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:35:05.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-19T12:35:05.928 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T12:35:05.928 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T12:35:05.978 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-19T12:35:05.979 DEBUG:teuthology.orchestra.run.trial109:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=624b9a7bcb2064ce17206482df6a1da007ff7675 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-19T12:35:06.031 INFO:tasks.workunit.client.0.trial109.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T12:35:06.035 INFO:tasks.workunit.client.0.trial109.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T12:35:06.035 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/divergent-priors 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-19T12:35:06.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-19T12:35:06.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-19T12:35:06.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-19T12:35:06.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-19T12:35:06.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-19T12:35:06.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-19T12:35:06.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-19T12:35:06.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-19T12:35:06.038 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-19T12:35:06.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-19T12:35:06.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-19T12:35:06.038 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-19T12:35:06.039 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-19T12:35:06.039 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-19T12:35:06.040 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-19T12:35:06.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-19T12:35:06.042 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-19T12:35:06.043 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none ' 2026-02-19T12:35:06.043 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-19T12:35:06.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-19T12:35:06.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-19T12:35:06.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:35:06.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-19T12:35:06.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:TEST_divergent_2 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:TEST_divergent_3 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:TEST_divergent_ec' 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:35:06.046 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:35:06.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:35:06.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:35:06.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:35:06.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:35:06.048 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:35:06.049 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:35:06.049 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:35:06.050 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:35:06.050 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:35:06.051 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:35:06.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:35:06.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:35:06.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:35:06.052 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:35:06.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:35:06.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:35:06.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:35:06.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:35:06.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:06.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:06.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:35:06.058 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:35:06.058 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:35:06.058 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T12:35:06.059 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:35:06.059 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:06.059 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:06.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16056 2026-02-19T12:35:06.061 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-19T12:35:06.062 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-19T12:35:06.063 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:06.063 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.nWbPBF6Pwd bs=512 count=1 2026-02-19T12:35:06.065 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:35:06.065 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:35:06.065 INFO:tasks.workunit.client.0.trial109.stderr:512 bytes copied, 0.000243623 s, 2.1 MB/s 2026-02-19T12:35:06.065 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:06.065 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:06.065 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-19T12:35:06.066 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-19T12:35:06.067 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:35:06.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T12:35:06.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T12:35:06.099 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:35:06.099 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:35:06.099 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:35:06.099 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:35:06.099 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:06.099 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:06.099 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:06.100 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:35:06.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:35:06.134 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:35:06.134 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:35:06.134 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:35:06.134 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:35:06.134 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:35:06.134 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:35:06.135 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:35:06.135 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:35:06.135 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:35:06.135 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:06.135 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:06.136 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:35:06.136 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:35:06.136 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get fsid 2026-02-19T12:35:06.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:35:06.190 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:35:06.190 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:35:06.190 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:35:06.190 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:35:06.190 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:35:06.190 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:35:06.190 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:35:06.191 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:35:06.191 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:06.191 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:06.191 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:35:06.192 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:35:06.192 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get mon_host 2026-02-19T12:35:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-19T12:35:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T12:35:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:35:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:35:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:35:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T12:35:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:35:06.358 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:35:06.358 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:35:06.358 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:35:06.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:35:06.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:06.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:06.359 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:06.359 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:35:06.360 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:35:06.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:06.384 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:35:06.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:35:06.386 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:35:06.386 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:35:06.386 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=33581a76-559c-45e3-b83a-00b29c38d0e1 2026-02-19T12:35:06.386 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 33581a76-559c-45e3-b83a-00b29c38d0e1' 2026-02-19T12:35:06.387 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 33581a76-559c-45e3-b83a-00b29c38d0e1 2026-02-19T12:35:06.387 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:35:06.398 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB6A5dpZy+VFxAA3XNcdSrRwAz+lEt+2VE7TA== 2026-02-19T12:35:06.398 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB6A5dpZy+VFxAA3XNcdSrRwAz+lEt+2VE7TA=="}' 2026-02-19T12:35:06.398 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 33581a76-559c-45e3-b83a-00b29c38d0e1 -i td/divergent-priors/0/new.json 2026-02-19T12:35:06.512 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:35:06.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T12:35:06.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB6A5dpZy+VFxAA3XNcdSrRwAz+lEt+2VE7TA== --osd-uuid 33581a76-559c-45e3-b83a-00b29c38d0e1 2026-02-19T12:35:06.541 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:06.535+0000 7efcf3b91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:06.542 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:06.539+0000 7efcf3b91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:06.543 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:06.539+0000 7efcf3b91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:06.543 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:06.539+0000 7efcf3b91a40 -1 bdev(0x55f791f06c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:35:06.544 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:06.539+0000 7efcf3b91a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T12:35:07.280 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T12:35:07.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:35:07.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:35:07.282 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:35:07.282 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:35:07.574 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:35:07.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:35:07.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:35:07.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:35:07.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:35:07.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:35:07.594 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:07.591+0000 7fd265bd2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:07.596 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:07.591+0000 7fd265bd2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:07.597 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:07.591+0000 7fd265bd2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:07.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:35:07.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:35:07.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:35:07.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:35:07.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:35:07.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:07.794 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:35:07.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:35:07.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:07.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:35:08.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:35:08.056 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:08.051+0000 7fd265bd2a40 -1 Falling back to public interface 2026-02-19T12:35:08.624 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:08.619+0000 7fd265bd2a40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:35:09.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:35:09.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:09.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:35:09.005 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:35:09.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:09.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:35:09.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:35:10.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:35:10.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:10.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:35:10.223 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:35:10.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:10.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:35:10.430 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1523566172,v1:127.0.0.1:6803/1523566172] [v2:127.0.0.1:6804/1523566172,v1:127.0.0.1:6805/1523566172] exists,up 33581a76-559c-45e3-b83a-00b29c38d0e1 2026-02-19T12:35:10.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:35:10.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:35:10.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:35:10.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-19T12:35:10.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-19T12:35:10.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:35:10.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:35:10.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:35:10.437 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:35:10.438 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3375a8c4-6d69-4b43-8e40-64a712fb2981 2026-02-19T12:35:10.438 INFO:tasks.workunit.client.0.trial109.stdout:add osd1 3375a8c4-6d69-4b43-8e40-64a712fb2981 2026-02-19T12:35:10.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 3375a8c4-6d69-4b43-8e40-64a712fb2981' 2026-02-19T12:35:10.439 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:35:10.450 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB+A5dpjC6vGhAARUOb01U6ZpYHQWpP6pR/pg== 2026-02-19T12:35:10.450 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB+A5dpjC6vGhAARUOb01U6ZpYHQWpP6pR/pg=="}' 2026-02-19T12:35:10.450 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3375a8c4-6d69-4b43-8e40-64a712fb2981 -i td/divergent-priors/1/new.json 2026-02-19T12:35:10.681 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:35:10.692 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T12:35:10.693 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+A5dpjC6vGhAARUOb01U6ZpYHQWpP6pR/pg== --osd-uuid 3375a8c4-6d69-4b43-8e40-64a712fb2981 2026-02-19T12:35:10.719 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:10.715+0000 7f60061d3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:10.721 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:10.715+0000 7f60061d3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:10.722 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:10.719+0000 7f60061d3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:10.723 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:10.719+0000 7f60061d3a40 -1 bdev(0x55de79c7ac00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T12:35:10.723 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:10.719+0000 7f60061d3a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T12:35:11.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T12:35:11.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:35:11.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T12:35:11.353 INFO:tasks.workunit.client.0.trial109.stdout:adding osd1 key to auth repository 2026-02-19T12:35:11.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:35:11.642 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:35:11.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T12:35:11.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:35:11.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:35:11.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:35:11.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:35:11.672 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:11.667+0000 7ff43bd79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:11.673 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:11.667+0000 7ff43bd79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:11.674 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:11.671+0000 7ff43bd79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:11.866 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T12:35:11.866 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:35:11.866 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:35:11.866 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:35:11.866 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:35:11.866 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:11.866 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:35:11.867 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:35:11.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:11.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:35:12.003 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:11.999+0000 7ff43bd79a40 -1 Falling back to public interface 2026-02-19T12:35:12.077 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:35:12.639 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:12.635+0000 7ff43bd79a40 -1 osd.1 0 log_to_monitors true 2026-02-19T12:35:13.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:35:13.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:13.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:35:13.080 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:35:13.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:13.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:35:13.285 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3622096127,v1:127.0.0.1:6811/3622096127] [v2:127.0.0.1:6812/3622096127,v1:127.0.0.1:6813/3622096127] exists,up 3375a8c4-6d69-4b43-8e40-64a712fb2981 2026-02-19T12:35:13.286 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:35:13.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:35:13.288 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:35:13.288 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:35:13.288 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:13.288 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:13.288 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:13.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:35:13.289 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:35:13.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ad32ee9f-582e-4ec7-a923-b9b1bc65c955 2026-02-19T12:35:13.290 INFO:tasks.workunit.client.0.trial109.stdout:add osd2 ad32ee9f-582e-4ec7-a923-b9b1bc65c955 2026-02-19T12:35:13.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ad32ee9f-582e-4ec7-a923-b9b1bc65c955' 2026-02-19T12:35:13.290 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:35:13.305 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCBA5dpO+AYEhAA8q4r0WhMTQ77xunihi4Csg== 2026-02-19T12:35:13.305 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCBA5dpO+AYEhAA8q4r0WhMTQ77xunihi4Csg=="}' 2026-02-19T12:35:13.305 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ad32ee9f-582e-4ec7-a923-b9b1bc65c955 -i td/divergent-priors/2/new.json 2026-02-19T12:35:13.522 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:35:13.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T12:35:13.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCBA5dpO+AYEhAA8q4r0WhMTQ77xunihi4Csg== --osd-uuid ad32ee9f-582e-4ec7-a923-b9b1bc65c955 2026-02-19T12:35:13.550 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:13.547+0000 7f80d2644a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:13.553 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:13.547+0000 7f80d2644a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:13.555 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:13.551+0000 7f80d2644a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:13.555 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:13.551+0000 7f80d2644a40 -1 bdev(0x5652c868ac00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T12:35:13.555 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:13.551+0000 7f80d2644a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T12:35:14.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T12:35:14.178 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:35:14.178 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T12:35:14.179 INFO:tasks.workunit.client.0.trial109.stdout:adding osd2 key to auth repository 2026-02-19T12:35:14.179 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:35:14.469 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:35:14.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T12:35:14.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:35:14.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:35:14.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:35:14.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:35:14.500 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:14.495+0000 7fb889e31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:14.501 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:14.495+0000 7fb889e31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:14.502 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:14.499+0000 7fb889e31a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:14.693 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T12:35:14.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:35:14.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:35:14.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:35:14.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:35:14.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:14.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:35:14.695 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:35:14.695 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:14.695 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:35:14.884 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:14.879+0000 7fb889e31a40 -1 Falling back to public interface 2026-02-19T12:35:14.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:35:15.472 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:15.467+0000 7fb889e31a40 -1 osd.2 0 log_to_monitors true 2026-02-19T12:35:15.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:35:15.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:15.905 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:35:15.905 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:35:15.906 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:15.906 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:35:16.118 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4154254345,v1:127.0.0.1:6819/4154254345] [v2:127.0.0.1:6820/4154254345,v1:127.0.0.1:6821/4154254345] exists,up ad32ee9f-582e-4ec7-a923-b9b1bc65c955 2026-02-19T12:35:16.119 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:35:16.119 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:35:16.119 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:35:16.119 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-19T12:35:16.410 INFO:tasks.workunit.client.0.trial109.stderr:noout is set 2026-02-19T12:35:16.419 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-19T12:35:16.741 INFO:tasks.workunit.client.0.trial109.stderr:noin is set 2026-02-19T12:35:16.751 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-19T12:35:17.045 INFO:tasks.workunit.client.0.trial109.stderr:nodown is set 2026-02-19T12:35:17.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-19T12:35:17.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-19T12:35:17.299 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' already exists 2026-02-19T12:35:17.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:35:18.310 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-19T12:35:18.617 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 size to 3 2026-02-19T12:35:18.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-19T12:35:18.921 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 min_size to 2 2026-02-19T12:35:18.931 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-19T12:35:18.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:35:18.932 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:35:19.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:35:19.155 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:35:19.155 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:35:19.155 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:35:19.155 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:19.155 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:35:19.233 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-19T12:35:19.234 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-19T12:35:19.234 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-19T12:35:19.234 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:19.234 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:35:19.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-19T12:35:19.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-19T12:35:19.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-19T12:35:19.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:19.316 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:35:19.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-19T12:35:19.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-19T12:35:19.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574851' 2026-02-19T12:35:19.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:19.400 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-19T12:35:19.400 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:19.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:35:19.401 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-19T12:35:19.402 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:19.403 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-19T12:35:19.403 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836484 2026-02-19T12:35:19.404 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-19T12:35:19.404 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:19.616 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-19T12:35:19.616 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:35:20.618 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:35:20.618 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:20.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-19T12:35:20.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:35:21.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:35:21.835 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:22.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-19T12:35:22.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:22.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-19T12:35:22.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:22.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:35:22.058 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-19T12:35:22.058 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:22.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-19T12:35:22.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-19T12:35:22.060 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705668 2026-02-19T12:35:22.060 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:35:22.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-19T12:35:22.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:22.285 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-19T12:35:22.285 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:22.286 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:35:22.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-19T12:35:22.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:22.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-19T12:35:22.288 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 55834574851 2026-02-19T12:35:22.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-19T12:35:22.289 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:35:22.514 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-19T12:35:22.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-19T12:35:22.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:35:22.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:35:22.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:35:22.515 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:35:22.516 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:35:22.516 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:35:22.516 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:35:22.516 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:35:22.516 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:35:22.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:35:22.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:35:22.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:35:22.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:35:22.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:35:22.620 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:35:22.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:35:22.826 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:35:22.826 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:35:22.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:35:22.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:22.827 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:35:22.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-19T12:35:22.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-19T12:35:22.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-19T12:35:22.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:22.911 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:35:22.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-19T12:35:22.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-19T12:35:22.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-19T12:35:22.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:22.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:35:23.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-19T12:35:23.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-19T12:35:23.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574854' 2026-02-19T12:35:23.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:23.074 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-19T12:35:23.074 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:23.074 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:35:23.075 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-19T12:35:23.075 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:23.077 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-19T12:35:23.077 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-19T12:35:23.077 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836487 2026-02-19T12:35:23.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:23.303 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-19T12:35:23.303 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:35:24.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:35:24.305 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:24.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-19T12:35:24.516 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:35:25.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:35:25.518 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:25.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836487 2026-02-19T12:35:25.738 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:25.738 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-19T12:35:25.739 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:25.740 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:35:25.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705670 2026-02-19T12:35:25.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:25.742 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705670 2026-02-19T12:35:25.742 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705670 2026-02-19T12:35:25.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-19T12:35:25.743 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:35:25.957 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705671 -lt 38654705670 2026-02-19T12:35:25.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:25.958 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-19T12:35:25.958 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:25.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:35:25.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574854 2026-02-19T12:35:25.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:25.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-19T12:35:25.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-19T12:35:25.962 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 55834574854 2026-02-19T12:35:25.962 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:35:26.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-19T12:35:26.178 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:35:26.178 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:26.179 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:26.457 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:35:26.457 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:26.458 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:26.458 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:26.459 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:26.459 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:26.459 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:26.459 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:26.668 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:35:26.669 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:26.669 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:26.669 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:26.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:35:26.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:35:26.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:35:26.952 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-19T12:35:26.952 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-19T12:35:27.157 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:35:27.166 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-19T12:35:27.167 INFO:tasks.workunit.client.0.trial109.stdout:primary and soon to be divergent is 1 2026-02-19T12:35:27.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-19T12:35:27.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-19T12:35:27.367 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:35:27.367 INFO:tasks.workunit.client.0.trial109.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T12:35:17.492050+0000 0'0 26:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:56:23.455507+0000 0 0 2026-02-19T12:35:27.367 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:35:27.367 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:35:27.368 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-19T12:35:27.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-19T12:35:27.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-19T12:35:27.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-19T12:35:27.378 INFO:tasks.workunit.client.0.trial109.stdout:writing initial objects 2026-02-19T12:35:27.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-19T12:35:27.379 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-19T12:35:27.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.429 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.430 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.458 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.458 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.543 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.543 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.600 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.676 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.676 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.760 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.760 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.884 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.938 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.938 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.966 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.966 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:27.994 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:27.994 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.023 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.023 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.107 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.107 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.276 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.276 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.303 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.303 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.331 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.331 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.387 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.388 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.444 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.444 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.499 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.500 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.583 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.583 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.612 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.612 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.639 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.640 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.687 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.687 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.714 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.738 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.739 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:28.979 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:28.979 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.108 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.108 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.137 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.194 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.194 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.251 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.251 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.307 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.307 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.335 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.335 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.362 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.362 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.390 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.390 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.419 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.419 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.447 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.447 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.559 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.586 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.586 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.671 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.671 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.755 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.755 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.832 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.832 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.914 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.943 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.943 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:29.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:29.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:30.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:30.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:30.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:30.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:30.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T12:35:30.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:30.094 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:35:30.094 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-19T12:35:30.094 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:35:30.094 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:35:30.094 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:35:30.095 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:35:30.095 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:35:30.095 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:35:30.096 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:35:30.096 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:35:30.096 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:35:30.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:35:30.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:35:30.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:35:30.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:35:30.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:35:30.162 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:35:30.368 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:35:30.368 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:35:30.369 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:35:30.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:35:30.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:30.370 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:35:30.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-19T12:35:30.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-19T12:35:30.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491' 2026-02-19T12:35:30.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:30.454 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:35:30.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-19T12:35:30.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-19T12:35:30.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-19T12:35:30.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:30.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:35:30.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-19T12:35:30.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-19T12:35:30.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574857' 2026-02-19T12:35:30.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:30.615 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-19T12:35:30.615 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:30.616 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:35:30.616 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836491 2026-02-19T12:35:30.617 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:30.618 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836491 2026-02-19T12:35:30.618 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-19T12:35:30.619 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836491 2026-02-19T12:35:30.619 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:30.838 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836491 2026-02-19T12:35:30.838 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:35:31.839 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:35:31.840 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:32.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-19T12:35:32.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:32.053 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-19T12:35:32.053 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:32.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:35:32.055 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-19T12:35:32.055 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:32.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-19T12:35:32.056 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705674 2026-02-19T12:35:32.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-19T12:35:32.057 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:35:32.272 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-19T12:35:32.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:32.274 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-19T12:35:32.274 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:32.274 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:35:32.275 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574857 2026-02-19T12:35:32.275 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:32.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-19T12:35:32.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-19T12:35:32.277 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 55834574857 2026-02-19T12:35:32.277 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:35:32.501 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-19T12:35:32.502 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:35:32.502 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:32.502 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:32.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:35:32.781 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:32.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:32.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:32.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:32.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:32.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:32.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:32.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:35:32.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:32.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:32.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:33.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:35:33.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:35:33.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:35:33.262 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-19T12:35:33.262 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T12:35:33.262 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T12:35:33.262 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T12:35:33.263 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T12:35:33.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-19T12:35:33.479 INFO:tasks.workunit.client.0.trial109.stdout:blackholing osds 0 2 2026-02-19T12:35:33.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-19T12:35:33.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-19T12:35:33.680 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:35:33.680 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T12:35:17.492050+0000 26'100 26:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:56:23.455507+0000 0 0 2026-02-19T12:35:33.680 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:35:33.680 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:35:33.681 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:35:33.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:33.690 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-19T12:35:33.690 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:35:33.690 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:35:33.690 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:35:33.690 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:33.690 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:33.691 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:35:33.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-19T12:35:33.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T12:35:33.745 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:35:33.745 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:35:33.745 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:35:33.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-19T12:35:33.752 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T12:35:33.803 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:35:33.803 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:35:33.803 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:35:33.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-19T12:35:33.809 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-19T12:35:33.809 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-19T12:35:33.810 INFO:tasks.workunit.client.0.trial109.stdout:writing divergent object 2026-02-19T12:35:33.810 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-19T12:35:33.811 INFO:tasks.workunit.client.0.trial109.stdout:create missing divergent object 2026-02-19T12:35:33.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=rep 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=test 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=existing_99 2026-02-19T12:35:33.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/divergent-priors 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds test existing_99 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-19T12:35:33.814 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-19T12:35:34.019 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr:0 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('1' '0' '2') 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' rep '!=' ec ']' 2026-02-19T12:35:34.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2497: inject_eio: shard_id= 2026-02-19T12:35:34.021 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/divergent-priors/1/type 2026-02-19T12:35:34.021 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-19T12:35:34.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-19T12:35:34.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-19T12:35:34.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-19T12:35:34.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-19T12:35:34.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-19T12:35:34.023 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-19T12:35:34.023 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-19T12:35:34.023 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:35:34.023 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:35:34.024 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:35:34.024 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:34.024 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:34.024 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:35:34.024 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.16056/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-19T12:35:34.085 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-19T12:35:34.085 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:34.087 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:35:34.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-19T12:35:34.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.1.asok injectdataerr test existing_99 2026-02-19T12:35:34.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-19T12:35:34.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-19T12:35:44.147 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-19T12:35:44.184 INFO:tasks.workunit.client.0.trial109.stderr:rados: no process found 2026-02-19T12:35:44.185 INFO:tasks.workunit.client.0.trial109.stdout:killing all the osds 2026-02-19T12:35:44.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-19T12:35:44.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-19T12:35:44.396 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:35:44.397 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-19T12:35:34.166768+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:56:23.455507+0000 0 0 2026-02-19T12:35:44.397 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:35:44.397 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:35:44.397 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:35:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-19T12:35:44.406 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:35:44.406 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:35:44.406 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:35:44.406 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:35:44.406 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:35:44.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:35:44.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-19T12:35:44.515 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-19T12:35:44.782 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:35:44.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-19T12:35:44.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-19T12:35:45.086 INFO:tasks.workunit.client.0.trial109.stderr:osd.1 is already down. 2026-02-19T12:35:45.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-19T12:35:45.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-19T12:35:45.361 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already down. 2026-02-19T12:35:45.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:45.372 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-19T12:35:45.648 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already out. 2026-02-19T12:35:45.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:45.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-19T12:35:45.923 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already out. 2026-02-19T12:35:45.933 INFO:tasks.workunit.client.0.trial109.stdout:bringing up non_divergent 0 2 2026-02-19T12:35:45.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-19T12:35:45.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-19T12:35:46.150 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:35:46.150 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-19T12:35:34.166768+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:56:23.455507+0000 0 0 2026-02-19T12:35:46.150 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:35:46.151 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:35:46.151 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:35:46.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:46.164 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:35:46.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:35:46.166 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:35:46.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:35:46.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:35:46.167 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T12:35:46.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:35:46.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:35:46.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:35:46.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:35:46.190 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:46.187+0000 7f23fc1fea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:46.192 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:46.187+0000 7f23fc1fea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:46.193 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:46.187+0000 7f23fc1fea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:46.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:35:46.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:35:46.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:35:46.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:35:46.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:35:46.381 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:46.381 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:35:46.381 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:35:46.381 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:46.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:35:46.591 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:46.587+0000 7f23fc1fea40 -1 Falling back to public interface 2026-02-19T12:35:46.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:35:47.245 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:47.239+0000 7f23fc1fea40 -1 osd.0 26 log_to_monitors true 2026-02-19T12:35:47.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:35:47.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:47.595 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:35:47.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:35:47.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:47.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:35:47.818 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up out weight 0 up_from 33 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6802/2467996578,v1:127.0.0.1:6803/2467996578] [v2:127.0.0.1:6804/2467996578,v1:127.0.0.1:6805/2467996578] exists,up 33581a76-559c-45e3-b83a-00b29c38d0e1 2026-02-19T12:35:47.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:35:47.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:35:47.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:35:47.823 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:35:47.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:35:47.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:35:47.825 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:35:47.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:35:47.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:35:47.826 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T12:35:47.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:35:47.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:35:47.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:35:47.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:35:47.848 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:47.843+0000 7f93230b5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:47.850 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:47.847+0000 7f93230b5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:47.851 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:47.847+0000 7f93230b5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:35:48.030 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:35:48.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:35:48.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:35:48.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:35:48.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:35:48.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:48.031 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:35:48.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:35:48.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:48.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:35:48.252 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:35:48.303 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:48.299+0000 7f93230b5a40 -1 Falling back to public interface 2026-02-19T12:35:48.977 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:35:48.971+0000 7f93230b5a40 -1 osd.2 26 log_to_monitors true 2026-02-19T12:35:49.253 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:35:49.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:35:49.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:35:49.254 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:35:49.255 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:35:49.255 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:35:49.469 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/610720586,v1:127.0.0.1:6811/610720586] [v2:127.0.0.1:6812/610720586,v1:127.0.0.1:6813/610720586] exists,up ad32ee9f-582e-4ec7-a923-b9b1bc65c955 2026-02-19T12:35:49.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:35:49.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:35:49.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:35:49.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:49.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-19T12:35:49.692 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already in. 2026-02-19T12:35:49.702 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-19T12:35:49.702 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-19T12:35:49.981 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already in. 2026-02-19T12:35:49.990 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:35:49.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-19T12:35:49.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:35:49.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:35:49.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:35:49.991 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:35:49.992 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:35:49.992 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:35:49.992 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:35:49.992 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:35:49.992 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:35:50.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:35:50.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:35:50.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:35:50.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:35:50.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:35:50.051 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:35:50.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:35:50.269 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:35:50.269 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:35:50.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:35:50.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:50.269 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:35:50.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-19T12:35:50.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-19T12:35:50.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771' 2026-02-19T12:35:50.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:50.353 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:35:50.413 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:35:50.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:35:50.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:35:50.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:35:50.416 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:35:50.416 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:35:50.500 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-19T12:35:50.500 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-19T12:35:50.500 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771 2-150323855363' 2026-02-19T12:35:50.500 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:50.501 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920771 2026-02-19T12:35:50.501 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:50.501 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:35:50.502 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-141733920771 2026-02-19T12:35:50.502 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:50.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920771 2026-02-19T12:35:50.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 141733920771' 2026-02-19T12:35:50.504 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 141733920771 2026-02-19T12:35:50.504 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:50.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 141733920771 2026-02-19T12:35:50.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:35:51.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:35:51.727 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:35:51.944 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920771 -lt 141733920771 2026-02-19T12:35:51.944 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:35:51.945 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-19T12:35:51.945 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:35:51.946 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:35:51.946 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-150323855363 2026-02-19T12:35:51.946 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:35:51.948 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855363 2026-02-19T12:35:51.948 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-19T12:35:51.948 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 150323855363 2026-02-19T12:35:51.948 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:35:52.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-19T12:35:52.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:35:52.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:52.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:52.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:52.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:35:52.651 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:52.652 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:52.652 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:52.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:35:52.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T12:35:52.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T12:35:52.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T12:35:52.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:35:52.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T12:35:53.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:35:53.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:53.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:53.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:53.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:53.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:53.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:53.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:53.251 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:35:53.251 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:53.251 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:53.252 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:53.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:35:53.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:35:53.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:35:53.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:35:53.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:35:53.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:35:53.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:35:53.550 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:35:53.550 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:35:53.831 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:35:53.831 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:35:53.831 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T12:35:53.831 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:35:53.831 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T12:35:54.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:35:54.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:54.032 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:54.033 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:54.033 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:54.033 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:54.033 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:54.034 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:54.243 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:35:54.244 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:54.244 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:54.244 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:54.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:35:54.536 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:35:54.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:35:54.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:35:54.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T12:35:54.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:35:54.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T12:35:55.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:35:55.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:55.222 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:55.222 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:55.222 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:55.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:55.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:55.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:55.430 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:35:55.430 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:55.430 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:55.431 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:55.707 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:35:55.708 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:35:55.984 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:35:55.985 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:35:55.985 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T12:35:55.985 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:35:55.985 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T12:35:56.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:35:56.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:56.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:56.787 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:56.787 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:56.787 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:56.787 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:56.787 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:56.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:35:56.997 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:56.998 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:56.998 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:35:57.275 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:35:57.276 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:35:57.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:35:57.554 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:35:57.554 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T12:35:57.554 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:35:57.554 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T12:35:59.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:35:59.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:35:59.154 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:35:59.154 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:35:59.154 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:35:59.155 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:35:59.155 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:35:59.155 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:35:59.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:35:59.363 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:35:59.363 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:35:59.363 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:35:59.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:35:59.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:35:59.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:35:59.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:35:59.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:35:59.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:35:59.647 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:35:59.647 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:35:59.647 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:35:59.921 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:35:59.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:35:59.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T12:35:59.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:35:59.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T12:36:03.122 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:36:03.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:36:03.124 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:36:03.124 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:36:03.124 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:36:03.124 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:36:03.124 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:36:03.124 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:36:03.335 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:36:03.336 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:36:03.336 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:36:03.336 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:36:03.613 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:36:03.614 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:36:03.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:36:03.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:36:03.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T12:36:03.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:36:03.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T12:36:10.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:36:10.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:36:10.305 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:36:10.305 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:36:10.305 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:36:10.305 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:36:10.306 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:36:10.306 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:36:10.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:36:10.522 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:36:10.522 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:36:10.522 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:36:10.807 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:36:10.808 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:36:11.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:36:11.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:36:11.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T12:36:11.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:36:11.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T12:36:18.388 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:36:18.389 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:36:18.389 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:36:18.389 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:36:18.389 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:36:18.389 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:36:18.390 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:36:18.390 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:36:18.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:36:18.596 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:36:18.596 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:36:18.596 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:36:18.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:36:18.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:36:18.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:36:18.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:36:18.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:36:18.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:36:18.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:36:18.877 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:36:18.877 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:36:19.155 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:36:19.155 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:36:19.155 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T12:36:19.155 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T12:36:19.438 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:36:19.438 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_fingerprint": "e37fbe2d-071e-4563-8f8e-6a266b235f06", 2026-02-19T12:36:19.438 INFO:tasks.workunit.client.0.trial109.stdout: "version": "20.2.0-720-g2fc421c8", 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "commit": "2fc421c83f0b86ea21b9e4289cad0f7957e09eb1", 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "timestamp": "2026-02-19T12:36:19.436459+0000", 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "tag": "", 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "health": { 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "status": "HEALTH_WARN", 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "checks": { 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "OSDMAP_FLAGS": { 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T12:36:19.439 INFO:tasks.workunit.client.0.trial109.stdout: "count": 17 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [], 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "OSD_DOWN": { 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "message": "1 osds down", 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.440 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "message": "osd.1 (root=default,host=trial109) is down" 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "PG_DEGRADED": { 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.441 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: "mutes": [] 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_first_committed": 1, 2026-02-19T12:36:19.442 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_last_committed": 1, 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "monmap": { 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:35:06.089327Z", 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:35:06.089327Z", 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release": 20, 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release_name": "tentacle", 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "election_strategy": 1, 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "disallowed_leaders": "", 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": false, 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "tiebreaker_mon": "", 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "removed_ranks": "", 2026-02-19T12:36:19.443 INFO:tasks.workunit.client.0.trial109.stdout: "features": { 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "persistent": [ 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "kraken", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "luminous", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "mimic", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap-prune", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "nautilus", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "octopus", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "pacific", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "elector-pinging", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "quincy", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "reef", 2026-02-19T12:36:19.444 INFO:tasks.workunit.client.0.trial109.stdout: "squid", 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "tentacle", 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "nvmeof_beacon_diff" 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "optional": [] 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "mons": [ 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "rank": 0, 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "name": "a", 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.445 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115", 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 0 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "priority": 0, 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 0, 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: "crush_location": "{}" 2026-02-19T12:36:19.446 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "quorum": [ 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: 0 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap": { 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 38, 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:35:06.174241+0000", 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:35:50.025246+0000", 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "last_up_change": "2026-02-19T12:35:49.128124+0000", 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "last_in_change": "2026-02-19T12:35:49.923071+0000", 2026-02-19T12:36:19.447 INFO:tasks.workunit.client.0.trial109.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "flags_num": 5800384, 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "flags_set": [ 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "nodown", 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "noin", 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "noout", 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "pglog_hardlimit", 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snapdirs", 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "recovery_deletes", 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "sortbitwise" 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "crush_version": 9, 2026-02-19T12:36:19.448 INFO:tasks.workunit.client.0.trial109.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_snapshot": "", 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "pool_max": 1, 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "max_osd": 3, 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "require_min_compat_client": "luminous", 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "min_compat_client": "jewel", 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "require_osd_release": "tentacle", 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "allow_crimson": false, 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "pools": [ 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.449 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "pool_name": "test", 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "create_time": "2026-02-19T12:35:17.215477+0000", 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "flags": 1, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "flags_names": "hashpspool", 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "size": 3, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "min_size": 2, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "crush_rule": 0, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_count": 0, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_target": 0, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T12:36:19.450 INFO:tasks.workunit.client.0.trial109.stdout: "is_stretch_pool": false, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "object_hash": 2, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "pg_autoscale_mode": "off", 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num": 1, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num": 1, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num_target": 1, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_target": 1, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_pending": 1, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "last_pg_merge_meta": { 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "source_pgid": "0.0", 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "ready_epoch": 0, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_started": 0, 2026-02-19T12:36:19.451 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": 0, 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "source_version": "0'0", 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "target_version": "0'0" 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "last_change": "26", 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend": "0", 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "auid": 0, 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "snap_mode": "selfmanaged", 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "snap_seq": 0, 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "snap_epoch": 0, 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "pool_snaps": [], 2026-02-19T12:36:19.452 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps": "[]", 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_bytes": 0, 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_objects": 0, 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "tiers": [], 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "tier_of": -1, 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "read_tier": -1, 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "write_tier": -1, 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "cache_mode": "none", 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_bytes": 0, 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_objects": 0, 2026-02-19T12:36:19.453 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_flush_age": 0, 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_evict_age": 0, 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profile": "", 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_params": { 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "type": "none" 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.454 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_period": 0, 2026-02-19T12:36:19.455 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_count": 0, 2026-02-19T12:36:19.455 INFO:tasks.workunit.client.0.trial109.stdout: "use_gmt_hitset": true, 2026-02-19T12:36:19.455 INFO:tasks.workunit.client.0.trial109.stdout: "min_read_recency_for_promote": 0, 2026-02-19T12:36:19.455 INFO:tasks.workunit.client.0.trial109.stdout: "min_write_recency_for_promote": 0, 2026-02-19T12:36:19.455 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T12:36:19.456 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_search_last_n": 0, 2026-02-19T12:36:19.456 INFO:tasks.workunit.client.0.trial109.stdout: "grade_table": [], 2026-02-19T12:36:19.456 INFO:tasks.workunit.client.0.trial109.stdout: "stripe_width": 0, 2026-02-19T12:36:19.456 INFO:tasks.workunit.client.0.trial109.stdout: "expected_num_objects": 0, 2026-02-19T12:36:19.456 INFO:tasks.workunit.client.0.trial109.stdout: "fast_read": false, 2026-02-19T12:36:19.456 INFO:tasks.workunit.client.0.trial109.stdout: "nonprimary_shards": "{}", 2026-02-19T12:36:19.457 INFO:tasks.workunit.client.0.trial109.stdout: "options": {}, 2026-02-19T12:36:19.457 INFO:tasks.workunit.client.0.trial109.stdout: "application_metadata": {}, 2026-02-19T12:36:19.457 INFO:tasks.workunit.client.0.trial109.stdout: "read_balance": { 2026-02-19T12:36:19.457 INFO:tasks.workunit.client.0.trial109.stdout: "score_type": "Fair distribution", 2026-02-19T12:36:19.457 INFO:tasks.workunit.client.0.trial109.stdout: "score_acting": 2.9900000095367432, 2026-02-19T12:36:19.457 INFO:tasks.workunit.client.0.trial109.stdout: "score_stable": 2.9900000095367432, 2026-02-19T12:36:19.457 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T12:36:19.458 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_acting": 2, 2026-02-19T12:36:19.458 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_stable": 2, 2026-02-19T12:36:19.458 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity_weighted": 1, 2026-02-19T12:36:19.459 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity": 1, 2026-02-19T12:36:19.459 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity_weighted": 1 2026-02-19T12:36:19.459 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.459 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.459 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.459 INFO:tasks.workunit.client.0.trial109.stdout: "osds": [ 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "33581a76-559c-45e3-b83a-00b29c38d0e1", 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:36:19.460 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 5, 2026-02-19T12:36:19.461 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 26, 2026-02-19T12:36:19.461 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 33, 2026-02-19T12:36:19.461 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 37, 2026-02-19T12:36:19.461 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 27, 2026-02-19T12:36:19.461 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6802", 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.462 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6803", 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6804", 2026-02-19T12:36:19.463 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6805", 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.464 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6808", 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6809", 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:36:19.465 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6806", 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6807", 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2467996578 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.466 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6803/2467996578", 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6805/2467996578", 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2467996578", 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2467996578", 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "3375a8c4-6d69-4b43-8e40-64a712fb2981", 2026-02-19T12:36:19.467 INFO:tasks.workunit.client.0.trial109.stdout: "up": 0, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 0, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 0, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 9, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 20, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 28, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.468 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.469 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:36:19.470 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.471 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.472 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3622096127 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/3622096127", 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/3622096127", 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3622096127", 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3622096127", 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: "exists" 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.473 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "ad32ee9f-582e-4ec7-a923-b9b1bc65c955", 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 13, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 26, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 35, 2026-02-19T12:36:19.474 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 0, 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 29, 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.475 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.476 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.477 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.478 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 610720586 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/610720586", 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/610720586", 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/610720586", 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/610720586", 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:36:19.479 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "osd_xinfo": [ 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:35:44.724391+0000", 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T12:36:19.480 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:35:45.029142+0000", 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:36:19.481 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:35:45.305115+0000", 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap": [], 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_items": [], 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_primaries": [], 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "pg_temp": [], 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "primary_temp": [], 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "blocklist": {}, 2026-02-19T12:36:19.482 INFO:tasks.workunit.client.0.trial109.stdout: "range_blocklist": {}, 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profiles": { 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "default": { 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "m": "2", 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps_queue": [], 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "new_removed_snaps": [], 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "new_purged_snaps": [], 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "crush_node_flags": {}, 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "device_class_flags": {}, 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": { 2026-02-19T12:36:19.483 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_enabled": false, 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_bucket_count": 0, 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "degraded_stretch_mode": 0, 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "recovering_stretch_mode": 0, 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_bucket": 0 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "osd_metadata": [ 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6804/2467996578,v1:127.0.0.1:6805/2467996578]", 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:36:19.484 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:36:19.485 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:35:07.183855Z", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6802/2467996578,v1:127.0.0.1:6803/2467996578]", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2467996578,v1:127.0.0.1:6809/2467996578]", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2467996578,v1:127.0.0.1:6807/2467996578]", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:36:19.486 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/3622096127,v1:127.0.0.1:6813/3622096127]", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:36:19.487 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:36:19.488 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:35:11.247744Z", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/3622096127,v1:127.0.0.1:6811/3622096127]", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3622096127,v1:127.0.0.1:6817/3622096127]", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3622096127,v1:127.0.0.1:6815/3622096127]", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:36:19.489 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/610720586,v1:127.0.0.1:6813/610720586]", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:36:19.490 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:36:19.491 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:35:14.063963Z", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/610720586,v1:127.0.0.1:6811/610720586]", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/610720586,v1:127.0.0.1:6817/610720586]", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/610720586,v1:127.0.0.1:6815/610720586]", 2026-02-19T12:36:19.492 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_clean_epochs": { 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "min_last_epoch_clean": 0, 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": { 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "per_pool": [] 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.493 INFO:tasks.workunit.client.0.trial109.stdout: "osd_epochs": [] 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_first_committed": 1, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_last_committed": 38, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "crushmap": { 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "devices": [ 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.0", 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.1", 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.2", 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:36:19.494 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "types": [ 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 0, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd" 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "name": "host" 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 2, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "name": "chassis" 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 3, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "name": "rack" 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 4, 2026-02-19T12:36:19.495 INFO:tasks.workunit.client.0.trial109.stdout: "name": "row" 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 5, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pdu" 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 6, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pod" 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 7, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "name": "room" 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 8, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "name": "datacenter" 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 9, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: "name": "zone" 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.496 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 10, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "name": "region" 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "name": "root" 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "buckets": [ 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "id": -1, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default", 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:36:19.497 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "id": -2, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default~ssd", 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109", 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:36:19.498 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:36:19.499 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109~ssd", 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.500 INFO:tasks.workunit.client.0.trial109.stdout: "rules": [ 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 0, 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "replicated_rule", 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_firstn", 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:36:19.501 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "tunables": { 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_tries": 0, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_fallback_tries": 0, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "choose_total_tries": 50, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_descend_once": 1, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_vary_r": 1, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_stable": 1, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "msr_descents": 100, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "msr_collision_tries": 100, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "straw_calc_version": 1, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "allowed_bucket_algs": 54, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "profile": "jewel", 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_tunables": 1, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "legacy_tunables": 0, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "minimum_required_version": "jewel", 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables": 1, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables2": 1, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "has_v2_rules": 0, 2026-02-19T12:36:19.502 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables3": 1, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "has_v3_rules": 0, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "has_v4_buckets": 1, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables5": 1, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "has_v5_rules": 0, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "has_msr_rules": 0 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "choose_args": {} 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "fsmap": { 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "btime": "2026-02-19T12:35:06:174019+0000", 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "default_fscid": -1, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "compat": { 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "compat": {}, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "ro_compat": {}, 2026-02-19T12:36:19.503 INFO:tasks.workunit.client.0.trial109.stdout: "incompat": { 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_1": "base v0.20", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stderr:report 3290146041 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_2": "client writeable ranges", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_4": "dir inode in separate object", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_8": "no anchor table", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_9": "file layout v2", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_10": "snaprealm v2", 2026-02-19T12:36:19.504 INFO:tasks.workunit.client.0.trial109.stdout: "feature_11": "minor log segments", 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "feature_flags": { 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "enable_multiple": true, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "ever_enabled_multiple": true 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "standbys": [], 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "filesystems": [] 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_first_committed": 1, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_last_committed": 1, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "auth": { 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 5, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "num_secrets": 3 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_active": 1, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_unknown": 0, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "num_osd": 3, 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "pool_sum": { 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:36:19.505 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51200, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 100, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 100, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:36:19.506 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 16, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 16, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "up": 2, 2026-02-19T12:36:19.507 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 2, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 0 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum": { 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83820, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2040, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 24, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81703, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488980, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036715520, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2088960, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 410164, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 24744, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83664728 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:36:19.508 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 1, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum_by_class": { 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "ssd": { 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83820, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2040, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 24, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81703, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488980, 2026-02-19T12:36:19.509 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036715520, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2088960, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 410164, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 24744, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83664728 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 1, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.510 INFO:tasks.workunit.client.0.trial109.stdout: "pool_stats": [ 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51200, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 100, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 100, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:36:19.511 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 1228800, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 153600, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:36:19.512 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 16, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 16, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "up": 2, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 2, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 3 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "osd_stats": [ 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 141733920777 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 38654705677 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 150323855368 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_state": [ 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded", 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "num": 1 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: "pool_pg_unavailable_map": [ 2026-02-19T12:36:19.513 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": "1", 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "pgs": [] 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_osd": [ 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 1, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 0, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": [ 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": {} 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "servicemap": { 2026-02-19T12:36:19.514 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 3, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:36:14.878125+0000", 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "services": { 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "osd": { 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "daemons": { 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "summary": "", 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "0": { 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "2": { 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_first_committed": 1, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_last_committed": 37, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "logm_first_committed": 1, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "logm_last_committed": 216, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "paxos": { 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 300, 2026-02-19T12:36:19.515 INFO:tasks.workunit.client.0.trial109.stdout: "last_pn": 0, 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stdout: "accepted_pn": 0 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stdout:writing non-divergent object existing_4 2026-02-19T12:36:19.516 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:19.647 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:19.648 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:35:50.029080+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:12:16.152006+0000 0 0 2026-02-19T12:36:19.648 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:19.648 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:19.648 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:19.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-19T12:36:19.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-19T12:36:19.658 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:36:19.658 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:36:19.658 INFO:tasks.workunit.client.0.trial109.stderr:1000 bytes (1.0 kB) copied, 1.602e-05 s, 62.4 MB/s 2026-02-19T12:36:19.679 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery 2026-02-19T12:36:19.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-19T12:36:19.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:19.884 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:19.885 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:35:50.029080+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:12:16.152006+0000 0 0 2026-02-19T12:36:19.885 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:19.885 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:19.885 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:19.893 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-19T12:36:19.894 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-19T12:36:19.895 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:36:19.895 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:36:19.895 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:36:19.895 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:19.895 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:19.895 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:36:19.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-19T12:36:19.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T12:36:19.950 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:36:19.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-19T12:36:19.957 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-19T12:36:19.957 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:36:19.957 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:36:19.957 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:36:19.957 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:19.957 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:19.957 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:36:19.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-19T12:36:19.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T12:36:20.010 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:36:20.016 INFO:tasks.workunit.client.0.trial109.stdout:revive divergent 1 2026-02-19T12:36:20.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-19T12:36:20.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:20.227 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:20.228 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:35:50.029080+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:12:16.152006+0000 0 0 2026-02-19T12:36:20.228 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:20.228 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:20.228 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:20.236 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-19T12:36:20.541 INFO:tasks.workunit.client.0.trial109.stderr:noup is set 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:36:20.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:36:20.556 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:36:20.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:36:20.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:36:20.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:36:20.558 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:36:20.559 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:36:20.559 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:36:20.560 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:36:20.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:36:20.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:36:20.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:36:20.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:36:20.581 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:20.574+0000 7f4ace1bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:20.582 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:20.578+0000 7f4ace1bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:20.583 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:20.578+0000 7f4ace1bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:20.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T12:36:20.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-19T12:36:20.967 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:20.962+0000 7f4ace1bba40 -1 Falling back to public interface 2026-02-19T12:36:21.663 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:21.658+0000 7f4ace1bba40 -1 osd.1 26 log_to_monitors true 2026-02-19T12:36:25.772 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery divergent 2026-02-19T12:36:25.772 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-19T12:36:25.772 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:25.970 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:25.971 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:35:50.029080+0000 38'101 41:136 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:12:16.152006+0000 0 0 2026-02-19T12:36:25.971 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:25.971 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:25.972 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:25.981 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-19T12:36:25.981 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:36:25.981 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:36:25.981 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:36:25.981 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:25.982 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:25.982 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:36:25.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-19T12:36:25.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T12:36:26.034 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:36:26.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-19T12:36:26.362 INFO:tasks.workunit.client.0.trial109.stderr:noup is unset 2026-02-19T12:36:26.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-19T12:36:26.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:36:26.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:36:26.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:36:26.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:36:26.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:36:26.378 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:36:26.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:36:26.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:36:26.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:36:26.591 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 33 up_thru 37 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6802/2467996578,v1:127.0.0.1:6803/2467996578] [v2:127.0.0.1:6804/2467996578,v1:127.0.0.1:6805/2467996578] exists,up 33581a76-559c-45e3-b83a-00b29c38d0e1 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:36:26.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:36:26.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:36:26.594 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:36:26.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:36:26.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:36:26.797 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/4009828698,v1:127.0.0.1:6819/4009828698] [v2:127.0.0.1:6820/4009828698,v1:127.0.0.1:6821/4009828698] exists,up 3375a8c4-6d69-4b43-8e40-64a712fb2981 2026-02-19T12:36:26.798 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:36:26.798 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:36:26.798 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:36:26.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-19T12:36:26.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:36:26.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:36:26.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:36:26.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:36:26.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:36:26.799 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:36:26.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:36:26.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:36:26.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:36:27.010 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/610720586,v1:127.0.0.1:6811/610720586] [v2:127.0.0.1:6812/610720586,v1:127.0.0.1:6813/610720586] exists,up ad32ee9f-582e-4ec7-a923-b9b1bc65c955 2026-02-19T12:36:27.010 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:36:27.010 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:36:27.010 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:36:27.010 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:27.205 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:27.205 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-19T12:36:26.363722+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:36:27.205 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:27.205 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:27.206 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:27.214 INFO:tasks.workunit.client.0.trial109.stdout:wait for peering 2026-02-19T12:36:27.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-19T12:36:27.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:27.428 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:27.428 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-19T12:36:26.363722+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:36:27.428 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:27.429 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:27.429 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:27.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:36:27.459 INFO:tasks.workunit.client.0.trial109.stdout:killing divergent 1 2026-02-19T12:36:27.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-19T12:36:27.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:27.667 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:27.667 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-19T12:36:26.363722+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:36:27.667 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:27.667 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:27.668 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:27.678 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T12:36:27.679 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:36:27.679 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:36:27.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:36:27.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:36:27.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:36:27.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:36:27.787 INFO:tasks.workunit.client.0.trial109.stdout:reviving divergent 1 2026-02-19T12:36:27.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-19T12:36:27.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:27.988 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:27.988 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-19T12:36:26.363722+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:36:27.988 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:27.988 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:27.988 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:36:27.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:28.000 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:36:28.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:36:28.002 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:36:28.002 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:36:28.002 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:36:28.002 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:36:28.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:36:28.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:36:28.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:36:28.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:36:28.025 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:28.018+0000 7f1c6a4f6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:28.026 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:28.022+0000 7f1c6a4f6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:28.027 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:28.022+0000 7f1c6a4f6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:28.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:36:28.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:36:28.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:36:28.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:36:28.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:36:28.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:36:28.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:36:28.222 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:36:28.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:36:28.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:36:28.407 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:28.402+0000 7f1c6a4f6a40 -1 Falling back to public interface 2026-02-19T12:36:28.436 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/4009828698,v1:127.0.0.1:6819/4009828698] [v2:127.0.0.1:6820/4009828698,v1:127.0.0.1:6821/4009828698] exists,up 3375a8c4-6d69-4b43-8e40-64a712fb2981 2026-02-19T12:36:28.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:36:28.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:36:28.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:36:28.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-19T12:36:29.066 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:29.062+0000 7f1c6a4f6a40 -1 osd.1 44 log_to_monitors true 2026-02-19T12:36:48.438 INFO:tasks.workunit.client.0.trial109.stdout:allowing recovery 2026-02-19T12:36:48.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-19T12:36:48.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:48.637 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:48.637 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-19T12:36:29.982701+0000 44'102 48:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:17:31.759238+0000 0 0 2026-02-19T12:36:48.638 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:48.638 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:48.638 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:48.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-19T12:36:48.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T12:36:48.717 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:36:48.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-19T12:36:48.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T12:36:48.811 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:36:48.818 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-19T12:36:48.818 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T12:36:48.899 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:36:48.908 INFO:tasks.workunit.client.0.trial109.stdout:reading divergent objects 2026-02-19T12:36:48.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-19T12:36:48.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-19T12:36:49.110 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:36:49.110 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-19T12:36:29.982701+0000 44'102 48:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:35:17.244288+0000 0'0 2026-02-19T12:35:17.244288+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:17:31.759238+0000 0 0 2026-02-19T12:36:49.110 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:36:49.110 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:36:49.110 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:36:49.119 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-19T12:36:49.121 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-19T12:36:49.122 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:36:49.122 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T12:36:49.143 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:36:49.143 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T12:36:49.172 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:36:49.172 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T12:36:49.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:36:49.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T12:36:49.228 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-19T12:36:49.230 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-19T12:36:49.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:36:49.235 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-19T12:35:33.827858+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T12:36:49.235 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 20 _merge_object_divergent_entries: keeping 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-19T12:35:33.827858+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 26'100 first_divergent_update: 26'101 last_divergent_update: 26'101 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 26'101 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-19T12:35:33.827858+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:36:26.942+0000 7f4aaf940640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-19T12:36:49.236 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-19T12:36:49.237 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:36:49.240 INFO:tasks.workunit.client.0.trial109.stdout:success 2026-02-19T12:36:49.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-19T12:36:49.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.nWbPBF6Pwd 2026-02-19T12:36:49.241 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-19T12:36:49.241 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T12:36:49.241 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T12:36:49.495 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' does not exist 2026-02-19T12:36:49.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-19T12:36:49.505 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:36:49.505 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:36:49.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:36:49.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:36:49.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:36:54.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:36:54.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T12:36:54.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:36:54.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:36:54.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:36:54.825 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:36:54.825 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:36:54.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:36:54.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:36:54.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:36:54.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:36:54.830 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:36:54.831 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:36:54.831 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:36:54.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:36:54.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:36:54.833 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:36:54.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:36:54.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:36:54.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:36:54.835 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:36:54.836 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:36:54.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:36:54.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:36:54.856 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:36:54.857 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:54.857 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:54.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:36:54.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:36:54.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:36:54.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T12:36:54.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T12:36:54.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T12:36:54.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T12:36:54.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:36:54.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:36:54.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:36:54.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:36:54.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:36:54.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:36:54.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:36:54.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:36:54.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:36:54.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:36:54.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:36:54.863 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:36:54.864 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:36:54.864 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:36:54.864 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:36:54.865 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:36:54.865 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:36:54.865 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:36:54.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:36:54.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:36:54.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:36:54.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:36:54.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:36:54.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:54.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:54.868 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:36:54.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:36:54.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:36:54.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T12:36:54.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:36:54.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:54.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:54.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16056 2026-02-19T12:36:54.872 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:36:54.873 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T12:36:54.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:36:54.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T12:36:54.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-19T12:36:54.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-19T12:36:54.874 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-19T12:36:54.874 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-19T12:36:54.875 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-19T12:36:54.875 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.BMKfK1AavN 2026-02-19T12:36:54.875 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.BMKfK1AavN bs=512 count=1 2026-02-19T12:36:54.876 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:36:54.876 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:36:54.876 INFO:tasks.workunit.client.0.trial109.stderr:512 bytes copied, 5.7196e-05 s, 9.0 MB/s 2026-02-19T12:36:54.876 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.BMKfK1AavN 2026-02-19T12:36:54.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.BMKfK1AavN 2026-02-19T12:36:54.877 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-19T12:36:54.877 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-19T12:36:54.877 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-19T12:36:54.878 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.DvDs6O770O 2026-02-19T12:36:54.878 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.DvDs6O770O bs=1000 count=1 2026-02-19T12:36:54.879 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:36:54.879 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:36:54.879 INFO:tasks.workunit.client.0.trial109.stderr:1000 bytes (1.0 kB) copied, 8.1892e-05 s, 12.2 MB/s 2026-02-19T12:36:54.879 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.DvDs6O770O 2026-02-19T12:36:54.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.DvDs6O770O 2026-02-19T12:36:54.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-19T12:36:54.880 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-19T12:36:54.881 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:36:54.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T12:36:54.884 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T12:36:54.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:36:54.907 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:36:54.907 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:36:54.907 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:36:54.907 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:54.907 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:54.907 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:54.907 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:36:54.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:36:54.937 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:36:54.937 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:36:54.937 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:36:54.937 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:36:54.939 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get fsid 2026-02-19T12:36:54.993 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:36:54.993 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:36:54.993 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:36:54.994 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:36:54.994 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:36:54.995 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:36:54.996 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get mon_host 2026-02-19T12:36:55.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-19T12:36:55.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T12:36:55.049 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:36:55.049 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:36:55.049 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:36:55.049 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T12:36:55.049 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:36:55.160 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:36:55.160 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:36:55.160 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:36:55.160 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:36:55.160 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:55.160 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:55.160 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:55.161 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:36:55.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:36:55.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-19T12:36:55.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-19T12:36:55.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:36:55.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:36:55.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:36:55.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:36:55.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:36:55.186 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:36:55.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:36:55.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:36:55.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:36:55.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:36:55.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:36:55.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:36:55.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:36:55.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bf32bfdc-a98f-436c-83dc-e5b882f863dc 2026-02-19T12:36:55.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 bf32bfdc-a98f-436c-83dc-e5b882f863dc' 2026-02-19T12:36:55.189 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 bf32bfdc-a98f-436c-83dc-e5b882f863dc 2026-02-19T12:36:55.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:36:55.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDnA5dpP17XCxAATFWz8UUXrAYdOePaBmdTcw== 2026-02-19T12:36:55.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDnA5dpP17XCxAATFWz8UUXrAYdOePaBmdTcw=="}' 2026-02-19T12:36:55.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bf32bfdc-a98f-436c-83dc-e5b882f863dc -i td/divergent-priors/0/new.json 2026-02-19T12:36:55.314 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:36:55.322 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T12:36:55.323 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnA5dpP17XCxAATFWz8UUXrAYdOePaBmdTcw== --osd-uuid bf32bfdc-a98f-436c-83dc-e5b882f863dc 2026-02-19T12:36:55.343 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:55.338+0000 7fe24f5eca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:55.345 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:55.338+0000 7fe24f5eca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:55.346 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:55.342+0000 7fe24f5eca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:55.346 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:55.342+0000 7fe24f5eca40 -1 bdev(0x55bd8e7e0c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:36:55.346 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:55.342+0000 7fe24f5eca40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T12:36:56.109 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T12:36:56.110 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:36:56.110 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:36:56.111 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:36:56.111 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:36:56.401 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:36:56.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:36:56.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:36:56.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:36:56.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:36:56.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:36:56.431 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:56.426+0000 7fc26a21da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:56.432 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:56.426+0000 7fc26a21da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:56.433 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:56.430+0000 7fc26a21da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:56.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:36:56.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:36:56.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:36:56.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:36:56.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:36:56.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:36:56.627 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:36:56.627 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:36:56.627 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:36:56.627 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:36:56.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:36:56.847 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:56.842+0000 7fc26a21da40 -1 Falling back to public interface 2026-02-19T12:36:57.463 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:57.458+0000 7fc26a21da40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:36:57.839 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:36:57.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:36:57.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:36:57.840 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:36:57.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:36:57.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:36:58.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:36:59.050 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:36:59.050 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:36:59.050 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:36:59.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:36:59.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:36:59.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:36:59.256 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/778065909,v1:127.0.0.1:6803/778065909] [v2:127.0.0.1:6804/778065909,v1:127.0.0.1:6805/778065909] exists,up bf32bfdc-a98f-436c-83dc-e5b882f863dc 2026-02-19T12:36:59.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:36:59.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:36:59.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:36:59.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:36:59.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:36:59.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:36:59.262 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:36:59.263 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:36:59.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=298f2f2e-5379-4beb-bdcc-e76e8800f353 2026-02-19T12:36:59.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 298f2f2e-5379-4beb-bdcc-e76e8800f353' 2026-02-19T12:36:59.264 INFO:tasks.workunit.client.0.trial109.stdout:add osd1 298f2f2e-5379-4beb-bdcc-e76e8800f353 2026-02-19T12:36:59.264 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:36:59.276 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrA5dppxVXEBAAfibBGa5WgHrtEdo6g1PoUQ== 2026-02-19T12:36:59.276 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrA5dppxVXEBAAfibBGa5WgHrtEdo6g1PoUQ=="}' 2026-02-19T12:36:59.276 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 298f2f2e-5379-4beb-bdcc-e76e8800f353 -i td/divergent-priors/1/new.json 2026-02-19T12:36:59.501 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:36:59.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T12:36:59.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrA5dppxVXEBAAfibBGa5WgHrtEdo6g1PoUQ== --osd-uuid 298f2f2e-5379-4beb-bdcc-e76e8800f353 2026-02-19T12:36:59.540 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:59.534+0000 7f61a8a33a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:59.541 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:59.538+0000 7f61a8a33a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:59.542 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:59.538+0000 7f61a8a33a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:36:59.543 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:59.538+0000 7f61a8a33a40 -1 bdev(0x55e306a7cc00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T12:36:59.543 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:36:59.538+0000 7f61a8a33a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T12:37:00.196 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T12:37:00.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:37:00.197 INFO:tasks.workunit.client.0.trial109.stdout:adding osd1 key to auth repository 2026-02-19T12:37:00.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T12:37:00.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:37:00.487 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:37:00.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T12:37:00.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:37:00.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:37:00.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:37:00.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:37:00.516 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:00.510+0000 7fd201b8ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:00.518 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:00.514+0000 7fd201b8ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:00.519 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:00.514+0000 7fd201b8ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:00.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T12:37:00.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:37:00.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:37:00.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:37:00.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:37:00.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:00.704 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:37:00.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:37:00.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:00.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:37:00.906 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:00.901+0000 7fd201b8ca40 -1 Falling back to public interface 2026-02-19T12:37:00.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:37:01.471 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:01.465+0000 7fd201b8ca40 -1 osd.1 0 log_to_monitors true 2026-02-19T12:37:01.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:37:01.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:01.916 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:37:01.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:37:01.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:01.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:37:02.126 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2158933337,v1:127.0.0.1:6811/2158933337] [v2:127.0.0.1:6812/2158933337,v1:127.0.0.1:6813/2158933337] exists,up 298f2f2e-5379-4beb-bdcc-e76e8800f353 2026-02-19T12:37:02.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:37:02.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:37:02.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:37:02.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-19T12:37:02.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:37:02.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:37:02.133 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:37:02.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:37:02.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:37:02.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:37:02.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:37:02.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:37:02.135 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:37:02.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08 2026-02-19T12:37:02.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08' 2026-02-19T12:37:02.136 INFO:tasks.workunit.client.0.trial109.stdout:add osd2 44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08 2026-02-19T12:37:02.136 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:37:02.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDuA5dpvU+WCBAACZxh1KClNQg6AJj5yroZIQ== 2026-02-19T12:37:02.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDuA5dpvU+WCBAACZxh1KClNQg6AJj5yroZIQ=="}' 2026-02-19T12:37:02.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08 -i td/divergent-priors/2/new.json 2026-02-19T12:37:02.356 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:37:02.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T12:37:02.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDuA5dpvU+WCBAACZxh1KClNQg6AJj5yroZIQ== --osd-uuid 44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08 2026-02-19T12:37:02.387 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:02.381+0000 7f05b1fc2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:02.388 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:02.381+0000 7f05b1fc2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:02.389 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:02.381+0000 7f05b1fc2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:02.389 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:02.385+0000 7f05b1fc2a40 -1 bdev(0x55e12145ec00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T12:37:02.390 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:02.385+0000 7f05b1fc2a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T12:37:03.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T12:37:03.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:37:03.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T12:37:03.042 INFO:tasks.workunit.client.0.trial109.stdout:adding osd2 key to auth repository 2026-02-19T12:37:03.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:37:03.328 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:37:03.329 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T12:37:03.329 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:37:03.329 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:37:03.329 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:37:03.330 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:37:03.358 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:03.353+0000 7fa97bc79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:03.360 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:03.353+0000 7fa97bc79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:03.361 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:03.353+0000 7fa97bc79a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:03.543 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:37:03.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:03.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:37:03.735 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:03.729+0000 7fa97bc79a40 -1 Falling back to public interface 2026-02-19T12:37:03.756 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:37:04.332 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:04.325+0000 7fa97bc79a40 -1 osd.2 0 log_to_monitors true 2026-02-19T12:37:04.758 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:37:04.759 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:04.761 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:37:04.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:37:04.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:04.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:37:04.972 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2355564836,v1:127.0.0.1:6819/2355564836] [v2:127.0.0.1:6820/2355564836,v1:127.0.0.1:6821/2355564836] exists,up 44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08 2026-02-19T12:37:04.972 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:37:04.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:37:04.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:37:04.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-19T12:37:05.247 INFO:tasks.workunit.client.0.trial109.stderr:noout is set 2026-02-19T12:37:05.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-19T12:37:05.552 INFO:tasks.workunit.client.0.trial109.stderr:noin is set 2026-02-19T12:37:05.562 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-19T12:37:05.907 INFO:tasks.workunit.client.0.trial109.stderr:nodown is set 2026-02-19T12:37:05.919 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-19T12:37:05.919 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-19T12:37:06.160 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' already exists 2026-02-19T12:37:06.170 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:37:07.171 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-19T12:37:07.478 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 size to 3 2026-02-19T12:37:07.487 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-19T12:37:07.783 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 min_size to 2 2026-02-19T12:37:07.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-19T12:37:07.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:37:07.796 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:37:08.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:37:08.012 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:37:08.012 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:37:08.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:37:08.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:08.013 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:37:08.093 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-19T12:37:08.093 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-19T12:37:08.093 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-19T12:37:08.093 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:08.093 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:37:08.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-19T12:37:08.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-19T12:37:08.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-19T12:37:08.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:08.177 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:37:08.256 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-19T12:37:08.256 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-19T12:37:08.256 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574851' 2026-02-19T12:37:08.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:08.257 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-19T12:37:08.257 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:08.258 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:37:08.259 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-19T12:37:08.259 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:08.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-19T12:37:08.260 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836484 2026-02-19T12:37:08.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-19T12:37:08.261 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:08.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-19T12:37:08.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:37:09.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:37:09.491 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:09.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-19T12:37:09.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:37:10.709 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:37:10.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:10.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-19T12:37:10.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:10.928 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-19T12:37:10.928 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:10.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:37:10.930 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-19T12:37:10.930 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:10.931 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-19T12:37:10.931 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-19T12:37:10.931 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705668 2026-02-19T12:37:10.931 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:37:11.153 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-19T12:37:11.153 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:11.154 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-19T12:37:11.154 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:11.155 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:37:11.156 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-19T12:37:11.156 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:11.157 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-19T12:37:11.157 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 55834574851 2026-02-19T12:37:11.157 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-19T12:37:11.158 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:37:11.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-19T12:37:11.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-19T12:37:11.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:37:11.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:37:11.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:37:11.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:37:11.385 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:37:11.385 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:37:11.385 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:37:11.385 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:37:11.385 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:37:11.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:37:11.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:37:11.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:37:11.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:37:11.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:37:11.479 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:37:11.698 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:37:11.699 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:37:11.699 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:37:11.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:37:11.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:11.699 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:37:11.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-19T12:37:11.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-19T12:37:11.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-19T12:37:11.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:11.780 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:37:11.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-19T12:37:11.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-19T12:37:11.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-19T12:37:11.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:11.863 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:37:11.948 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-19T12:37:11.948 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-19T12:37:11.949 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574854' 2026-02-19T12:37:11.949 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:11.949 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-19T12:37:11.949 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:11.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:37:11.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-19T12:37:11.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:11.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-19T12:37:11.952 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836487 2026-02-19T12:37:11.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-19T12:37:11.953 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:12.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-19T12:37:12.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:37:13.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:37:13.177 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:13.388 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-19T12:37:13.388 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:37:14.390 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:37:14.390 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:14.606 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836487 2026-02-19T12:37:14.606 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:14.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-19T12:37:14.607 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:14.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:37:14.608 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705670 2026-02-19T12:37:14.608 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:14.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705670 2026-02-19T12:37:14.610 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705670 2026-02-19T12:37:14.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-19T12:37:14.610 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:37:14.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705671 -lt 38654705670 2026-02-19T12:37:14.842 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:14.842 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-19T12:37:14.842 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:14.843 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:37:14.844 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574854 2026-02-19T12:37:14.844 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:14.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-19T12:37:14.845 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 55834574854 2026-02-19T12:37:14.846 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-19T12:37:14.846 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:37:15.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-19T12:37:15.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:37:15.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:15.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:15.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:15.586 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:37:15.586 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:15.587 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:15.587 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:15.891 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:37:15.891 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:37:15.891 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:37:15.892 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-19T12:37:15.892 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-19T12:37:16.098 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:37:16.108 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-19T12:37:16.108 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-19T12:37:16.109 INFO:tasks.workunit.client.0.trial109.stdout:primary and soon to be divergent is 1 2026-02-19T12:37:16.109 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:37:16.312 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:37:16.313 INFO:tasks.workunit.client.0.trial109.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T12:37:06.399329+0000 0'0 26:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T15:37:59.021978+0000 0 0 2026-02-19T12:37:16.313 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:37:16.313 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:37:16.313 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:37:16.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-19T12:37:16.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-19T12:37:16.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-19T12:37:16.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-19T12:37:16.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-19T12:37:16.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-19T12:37:16.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-19T12:37:16.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-19T12:37:16.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-19T12:37:16.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-19T12:37:16.326 INFO:tasks.workunit.client.0.trial109.stdout:writing initial objects 2026-02-19T12:37:16.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-19T12:37:16.327 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-19T12:37:16.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.463 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.463 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.519 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.519 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.547 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.547 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.603 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.603 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.631 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.631 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.687 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.687 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.716 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.717 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.744 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.744 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.801 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.911 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.939 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.939 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.966 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:16.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:16.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.019 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.019 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.104 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.104 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.157 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.157 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.184 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.213 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.213 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.241 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.311 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.311 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.330 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.330 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.572 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.572 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.600 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.600 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.740 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.741 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.796 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.796 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.924 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.924 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.948 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.948 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.969 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.969 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:17.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:17.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.085 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.085 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.113 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.113 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.168 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.168 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.195 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.196 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.244 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.244 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.317 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.317 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.373 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.373 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.393 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.393 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.413 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.413 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.469 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.579 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.579 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.692 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.692 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.740 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.740 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.849 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.849 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T12:37:18.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.BMKfK1AavN 2026-02-19T12:37:18.988 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:37:18.988 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-19T12:37:18.988 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:37:18.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:37:18.989 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:37:18.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:37:18.990 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:37:18.990 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:37:18.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:37:18.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:37:18.990 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:37:19.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:37:19.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:37:19.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:37:19.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:37:19.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:37:19.048 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:37:19.272 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:37:19.272 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:37:19.272 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:37:19.272 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:37:19.272 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:19.272 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:37:19.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-19T12:37:19.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-19T12:37:19.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491' 2026-02-19T12:37:19.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:19.353 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:37:19.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-19T12:37:19.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-19T12:37:19.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-19T12:37:19.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:19.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:37:19.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-19T12:37:19.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-19T12:37:19.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574857' 2026-02-19T12:37:19.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:19.518 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-19T12:37:19.518 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:19.519 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:37:19.519 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836491 2026-02-19T12:37:19.519 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:19.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836491 2026-02-19T12:37:19.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-19T12:37:19.521 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836491 2026-02-19T12:37:19.522 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:19.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-19T12:37:19.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:19.747 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-19T12:37:19.747 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:19.747 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:37:19.748 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-19T12:37:19.748 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:19.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-19T12:37:19.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-19T12:37:19.750 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705674 2026-02-19T12:37:19.750 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:37:19.969 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-19T12:37:19.969 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:19.970 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-19T12:37:19.970 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:19.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:37:19.971 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574857 2026-02-19T12:37:19.971 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:19.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-19T12:37:19.973 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 55834574857 2026-02-19T12:37:19.974 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-19T12:37:19.974 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:37:20.201 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-19T12:37:20.202 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:37:20.203 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:20.203 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:20.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:37:20.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:20.487 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:20.487 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:20.487 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:20.487 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:20.487 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:20.487 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:20.702 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:37:20.702 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:20.702 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:20.703 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:20.990 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:37:20.990 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:37:20.990 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:37:20.991 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-19T12:37:20.991 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T12:37:20.991 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T12:37:20.991 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T12:37:20.991 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T12:37:21.208 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-19T12:37:21.208 INFO:tasks.workunit.client.0.trial109.stdout:blackholing osds 0 2 2026-02-19T12:37:21.208 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-19T12:37:21.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:37:21.412 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:37:21.412 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T12:37:06.399329+0000 28'100 28:127 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T15:37:59.021978+0000 0 0 2026-02-19T12:37:21.412 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:37:21.413 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:37:21.413 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:37:21.421 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:21.422 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-19T12:37:21.422 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:37:21.422 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:37:21.422 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:37:21.422 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:37:21.422 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:37:21.423 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:37:21.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-19T12:37:21.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T12:37:21.477 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:37:21.477 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:37:21.477 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:37:21.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:21.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-19T12:37:21.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:37:21.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:37:21.484 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:37:21.484 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:37:21.484 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:37:21.484 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:37:21.485 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-19T12:37:21.485 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T12:37:21.536 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:37:21.536 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:37:21.536 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:37:21.542 INFO:tasks.workunit.client.0.trial109.stdout:create new divergent objects 2026-02-19T12:37:21.542 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-19T12:37:21.542 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-19T12:37:21.543 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:37:21.543 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:37:21.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-19T12:37:21.544 INFO:tasks.workunit.client.0.trial109.stdout:writing divergent objects 2026-02-19T12:37:21.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-19T12:37:21.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-19T12:37:21.545 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-19T12:37:21.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T12:37:21.545 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T12:37:21.546 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.DvDs6O770O 2026-02-19T12:37:21.546 INFO:tasks.workunit.client.0.trial109.stdout:remove divergent objects 2026-02-19T12:37:21.547 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-19T12:37:21.547 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.DvDs6O770O 2026-02-19T12:37:21.547 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-19T12:37:21.547 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T12:37:21.547 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-19T12:37:21.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-19T12:37:21.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T12:37:21.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-19T12:37:21.549 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-19T12:37:21.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-19T12:37:21.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-19T12:37:21.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-19T12:37:31.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-19T12:37:31.599 INFO:tasks.workunit.client.0.trial109.stderr:rados: no process found 2026-02-19T12:37:31.599 INFO:tasks.workunit.client.0.trial109.stdout:killing all the osds 2026-02-19T12:37:31.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-19T12:37:31.600 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:37:31.815 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:37:31.815 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-19T12:37:06.399329+0000 28'106 28:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T15:37:59.021978+0000 0 0 2026-02-19T12:37:31.815 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:37:31.815 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:37:31.816 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:37:31.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-19T12:37:31.826 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:37:31.826 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:37:31.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:37:31.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:37:31.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:37:31.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:37:31.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-19T12:37:31.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-19T12:37:32.205 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:37:32.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-19T12:37:32.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-19T12:37:32.481 INFO:tasks.workunit.client.0.trial109.stderr:osd.1 is already down. 2026-02-19T12:37:32.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-19T12:37:32.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-19T12:37:32.769 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already down. 2026-02-19T12:37:32.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:32.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-19T12:37:33.042 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already out. 2026-02-19T12:37:33.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:33.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-19T12:37:33.324 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already out. 2026-02-19T12:37:33.334 INFO:tasks.workunit.client.0.trial109.stdout:bringing up non_divergent 0 2 2026-02-19T12:37:33.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-19T12:37:33.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:37:33.553 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:37:33.553 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-19T12:37:06.399329+0000 28'106 28:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T15:37:59.021978+0000 0 0 2026-02-19T12:37:33.553 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:37:33.553 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:37:33.554 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:37:33.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:33.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-19T12:37:33.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:37:33.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:37:33.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:37:33.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:37:33.566 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:37:33.566 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:37:33.566 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:37:33.566 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T12:37:33.566 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:37:33.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:37:33.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:37:33.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:37:33.592 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:33.586+0000 7fd7219dca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:33.593 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:33.586+0000 7fd7219dca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:33.594 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:33.586+0000 7fd7219dca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:33.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:37:33.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:37:33.781 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:37:33.781 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:37:33.781 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:37:33.781 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:33.781 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:37:33.782 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:37:33.782 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:33.782 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:37:33.995 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:37:34.005 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:33.998+0000 7fd7219dca40 -1 Falling back to public interface 2026-02-19T12:37:34.662 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:34.654+0000 7fd7219dca40 -1 osd.0 28 log_to_monitors true 2026-02-19T12:37:34.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:37:34.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:34.997 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:37:34.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:37:34.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:34.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:37:35.214 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6802/2791137565,v1:127.0.0.1:6803/2791137565] [v2:127.0.0.1:6804/2791137565,v1:127.0.0.1:6805/2791137565] exists,up bf32bfdc-a98f-436c-83dc-e5b882f863dc 2026-02-19T12:37:35.217 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:37:35.217 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:37:35.217 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:37:35.217 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:37:35.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:37:35.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:37:35.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:37:35.221 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:37:35.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:37:35.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:37:35.222 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T12:37:35.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:37:35.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:37:35.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:37:35.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:37:35.239 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:35.230+0000 7faf0a66da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:35.240 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:35.234+0000 7faf0a66da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:35.241 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:35.234+0000 7faf0a66da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:35.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:37:35.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:37:35.733 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:35.726+0000 7faf0a66da40 -1 Falling back to public interface 2026-02-19T12:37:36.346 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:37:36.338+0000 7faf0a66da40 -1 osd.2 28 log_to_monitors true 2026-02-19T12:37:36.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:37:36.659 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:37:36.659 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:37:36.659 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:37:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:37:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:37:36.876 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/6555484,v1:127.0.0.1:6811/6555484] [v2:127.0.0.1:6812/6555484,v1:127.0.0.1:6813/6555484] exists,up 44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08 2026-02-19T12:37:36.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:37:36.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:37:36.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:37:36.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:36.878 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-19T12:37:37.123 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already in. 2026-02-19T12:37:37.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:37:37.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-19T12:37:37.414 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already in. 2026-02-19T12:37:37.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:37:37.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-19T12:37:37.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:37:37.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:37:37.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:37:37.425 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:37:37.426 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:37:37.426 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:37:37.426 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:37:37.426 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:37:37.426 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:37:37.494 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:37:37.494 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:37:37.494 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:37:37.494 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:37:37.494 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:37:37.494 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:37:37.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:37:37.713 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:37:37.713 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:37:37.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:37:37.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:37.713 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:37:37.796 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-19T12:37:37.797 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-19T12:37:37.797 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855363' 2026-02-19T12:37:37.797 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:37.797 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:37:37.859 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:37:37.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:37:37.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:37:37.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:37:37.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:37:37.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:37:37.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-19T12:37:37.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-19T12:37:37.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855363 2-158913789955' 2026-02-19T12:37:37.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:37.952 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-19T12:37:37.953 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:37.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:37:37.954 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-150323855363 2026-02-19T12:37:37.954 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:37.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855363 2026-02-19T12:37:37.956 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 150323855363 2026-02-19T12:37:37.956 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-19T12:37:37.956 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:38.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 150323855363 2026-02-19T12:37:38.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:37:39.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:37:39.176 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:39.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 150323855363 2026-02-19T12:37:39.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:37:40.393 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:37:40.394 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:37:40.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-19T12:37:40.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:37:40.609 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-19T12:37:40.609 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:37:40.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:37:40.611 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-158913789955 2026-02-19T12:37:40.611 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:37:40.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789955 2026-02-19T12:37:40.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-19T12:37:40.613 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 158913789955 2026-02-19T12:37:40.613 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:37:40.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-19T12:37:40.824 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:37:40.824 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:40.824 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:41.113 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:41.329 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:41.330 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:41.330 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:41.330 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:41.621 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:41.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T12:37:41.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T12:37:41.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T12:37:41.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:41.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T12:37:41.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:37:41.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:41.723 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:41.723 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:41.724 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:41.724 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:41.724 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:41.724 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:41.939 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:41.940 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:41.940 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:41.940 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:42.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:42.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:37:42.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:37:42.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:37:42.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:37:42.227 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:37:42.227 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:37:42.227 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:37:42.227 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:37:42.514 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:37:42.514 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:37:42.514 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T12:37:42.514 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:42.514 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T12:37:42.716 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:37:42.716 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:42.716 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:42.716 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:42.716 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:42.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:42.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:42.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:42.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:42.927 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:42.927 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:42.927 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:43.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:43.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:37:43.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:37:43.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:37:43.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:37:43.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:37:43.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:37:43.204 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:37:43.204 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:37:43.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:37:43.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:37:43.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T12:37:43.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:43.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T12:37:43.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:37:43.900 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:43.901 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:43.901 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:43.901 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:43.901 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:43.901 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:43.901 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:44.115 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:44.116 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:44.116 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:44.116 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:37:44.405 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:37:44.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:37:44.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:37:44.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T12:37:44.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:44.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T12:37:45.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:37:45.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:45.491 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:45.492 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:45.492 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:45.492 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:45.492 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:45.492 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:45.709 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:45.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:45.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:45.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:45.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:45.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:37:45.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:37:45.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:37:45.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:37:45.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:37:45.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:37:45.999 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:37:45.999 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:37:46.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:37:46.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:37:46.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T12:37:46.272 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:46.272 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T12:37:47.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:37:47.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:47.873 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:47.873 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:47.873 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:47.873 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:47.874 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:47.874 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:48.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:48.080 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:48.081 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:48.081 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:48.362 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:48.362 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:37:48.362 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:37:48.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:37:48.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:37:48.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:37:48.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:37:48.363 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:37:48.363 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:37:48.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:37:48.637 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:37:48.637 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T12:37:48.637 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:48.637 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T12:37:51.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:37:51.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:51.838 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:51.839 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:51.839 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:51.839 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:51.839 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:51.839 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:52.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:52.052 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:52.052 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:52.052 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:52.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:52.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:37:52.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:37:52.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:37:52.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:37:52.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:37:52.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:37:52.347 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:37:52.347 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:37:52.647 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:37:52.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:37:52.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T12:37:52.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:52.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T12:37:59.048 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:37:59.049 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:37:59.050 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:37:59.050 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:37:59.050 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:37:59.051 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:37:59.051 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:37:59.051 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:37:59.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:37:59.264 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:37:59.264 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:37:59.264 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:37:59.553 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:37:59.554 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:37:59.839 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:37:59.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:37:59.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T12:37:59.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:37:59.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T12:38:07.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:07.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:07.142 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:07.142 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:07.142 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:07.142 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:07.142 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:07.142 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:07.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:07.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:07.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:07.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:07.635 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:07.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:07.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:07.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:07.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:07.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:07.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:07.637 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:07.637 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:07.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:07.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:07.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T12:38:07.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_fingerprint": "0223ca32-5be1-4691-b4bb-7826f3d02e1f", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "version": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "commit": "2fc421c83f0b86ea21b9e4289cad0f7957e09eb1", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "timestamp": "2026-02-19T12:38:08.188888+0000", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "tag": "", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "health": { 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "status": "HEALTH_WARN", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "checks": { 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "OSDMAP_FLAGS": { 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "count": 17 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [], 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "OSD_DOWN": { 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:38:08.194 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "message": "1 osds down", 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "message": "osd.1 (root=default,host=trial109) is down" 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "PG_DEGRADED": { 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "mutes": [] 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_first_committed": 1, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_last_committed": 1, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "monmap": { 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:38:08.195 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:36:54.897994Z", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:36:54.897994Z", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release": 20, 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release_name": "tentacle", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "election_strategy": 1, 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "disallowed_leaders": "", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": false, 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "tiebreaker_mon": "", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "removed_ranks": "", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "features": { 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "persistent": [ 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "kraken", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "luminous", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "mimic", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap-prune", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "nautilus", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "octopus", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "pacific", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "elector-pinging", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "quincy", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "reef", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "squid", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "tentacle", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "nvmeof_beacon_diff" 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "optional": [] 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "mons": [ 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "rank": 0, 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "name": "a", 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.196 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 0 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "priority": 0, 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 0, 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "crush_location": "{}" 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "quorum": [ 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: 0 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap": { 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 40, 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:36:54.978197+0000", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:37:37.456330+0000", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "last_up_change": "2026-02-19T12:37:36.498253+0000", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "last_in_change": "2026-02-19T12:37:37.353933+0000", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "flags_num": 5800384, 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "flags_set": [ 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "nodown", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "noin", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "noout", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "pglog_hardlimit", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snapdirs", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "recovery_deletes", 2026-02-19T12:38:08.197 INFO:tasks.workunit.client.0.trial109.stdout: "sortbitwise" 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "crush_version": 9, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_snapshot": "", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pool_max": 1, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "max_osd": 3, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "require_min_compat_client": "luminous", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "min_compat_client": "jewel", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "require_osd_release": "tentacle", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "allow_crimson": false, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pools": [ 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pool_name": "test", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "create_time": "2026-02-19T12:37:06.084619+0000", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "flags": 1, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "flags_names": "hashpspool", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "size": 3, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "min_size": 2, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "crush_rule": 0, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_count": 0, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_target": 0, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "is_stretch_pool": false, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "object_hash": 2, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pg_autoscale_mode": "off", 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num": 1, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num": 1, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num_target": 1, 2026-02-19T12:38:08.198 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_target": 1, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_pending": 1, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "last_pg_merge_meta": { 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "source_pgid": "0.0", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "ready_epoch": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_started": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "source_version": "0'0", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "target_version": "0'0" 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "last_change": "26", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend": "0", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "auid": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "snap_mode": "selfmanaged", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "snap_seq": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "snap_epoch": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "pool_snaps": [], 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps": "[]", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_bytes": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_objects": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "tiers": [], 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "tier_of": -1, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "read_tier": -1, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "write_tier": -1, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "cache_mode": "none", 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_bytes": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_objects": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_flush_age": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_evict_age": 0, 2026-02-19T12:38:08.199 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profile": "", 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_params": { 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "type": "none" 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_period": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_count": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "use_gmt_hitset": true, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "min_read_recency_for_promote": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "min_write_recency_for_promote": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_search_last_n": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "grade_table": [], 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "stripe_width": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "expected_num_objects": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "fast_read": false, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "nonprimary_shards": "{}", 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "options": {}, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "application_metadata": {}, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "read_balance": { 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "score_type": "Fair distribution", 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "score_acting": 2.9900000095367432, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "score_stable": 2.9900000095367432, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_acting": 2, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_stable": 2, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity_weighted": 1, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity": 1, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity_weighted": 1 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "osds": [ 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:08.200 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "bf32bfdc-a98f-436c-83dc-e5b882f863dc", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 5, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 28, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 35, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 39, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 29, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6802", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6803", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6804", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.201 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6805", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6808", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6809", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6806", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6807", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6803/2791137565", 2026-02-19T12:38:08.202 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6805/2791137565", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2791137565", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2791137565", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "298f2f2e-5379-4beb-bdcc-e76e8800f353", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "up": 0, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 0, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 0, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 9, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 20, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 30, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.203 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.204 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/2158933337", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/2158933337", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2158933337", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2158933337", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "exists" 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 13, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 28, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 37, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 0, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 31, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.205 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.206 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/6555484", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/6555484", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/6555484", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/6555484", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "osd_xinfo": [ 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:37:32.144317+0000", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:36:58.449685+0000", 2026-02-19T12:38:08.207 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:37:32.420046+0000", 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:37:02.478311+0000", 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:37:32.711092+0000", 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:37:05.329101+0000", 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap": [], 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_items": [], 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_primaries": [], 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "pg_temp": [], 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "primary_temp": [], 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "blocklist": {}, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "range_blocklist": {}, 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profiles": { 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "default": { 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "m": "2", 2026-02-19T12:38:08.208 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps_queue": [], 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "new_removed_snaps": [], 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "new_purged_snaps": [], 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "crush_node_flags": {}, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "device_class_flags": {}, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": { 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_enabled": false, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_bucket_count": 0, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "degraded_stretch_mode": 0, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "recovering_stretch_mode": 0, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_bucket": 0 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "osd_metadata": [ 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6804/2791137565,v1:127.0.0.1:6805/2791137565]", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:38:08.209 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:36:55.992449Z", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6802/2791137565,v1:127.0.0.1:6803/2791137565]", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2791137565,v1:127.0.0.1:6809/2791137565]", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2791137565,v1:127.0.0.1:6807/2791137565]", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:38:08.210 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/2158933337,v1:127.0.0.1:6813/2158933337]", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:37:00.102495Z", 2026-02-19T12:38:08.211 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/2158933337,v1:127.0.0.1:6811/2158933337]", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2158933337,v1:127.0.0.1:6817/2158933337]", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2158933337,v1:127.0.0.1:6815/2158933337]", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/6555484,v1:127.0.0.1:6813/6555484]", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:38:08.212 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:37:02.939809Z", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/6555484,v1:127.0.0.1:6811/6555484]", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/6555484,v1:127.0.0.1:6817/6555484]", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/6555484,v1:127.0.0.1:6815/6555484]", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:38:08.213 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_clean_epochs": { 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "min_last_epoch_clean": 24, 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": { 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "per_pool": [ 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "floor": 24 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "osd_epochs": [ 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 35 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 38 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.214 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_first_committed": 1, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_last_committed": 40, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "crushmap": { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "devices": [ 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.0", 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.1", 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.2", 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "types": [ 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 0, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd" 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "name": "host" 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 2, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "name": "chassis" 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 3, 2026-02-19T12:38:08.215 INFO:tasks.workunit.client.0.trial109.stdout: "name": "rack" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 4, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "row" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 5, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pdu" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 6, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pod" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 7, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "room" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 8, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "datacenter" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 9, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "zone" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 10, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "region" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "name": "root" 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.216 INFO:tasks.workunit.client.0.trial109.stdout: "buckets": [ 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "id": -1, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "id": -2, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default~ssd", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:38:08.217 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109~ssd", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.218 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "rules": [ 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 0, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "replicated_rule", 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_firstn", 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.219 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "tunables": { 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_tries": 0, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_fallback_tries": 0, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "choose_total_tries": 50, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_descend_once": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_vary_r": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_stable": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "msr_descents": 100, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "msr_collision_tries": 100, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "straw_calc_version": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "allowed_bucket_algs": 54, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "profile": "jewel", 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_tunables": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "legacy_tunables": 0, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "minimum_required_version": "jewel", 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables2": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "has_v2_rules": 0, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables3": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "has_v3_rules": 0, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "has_v4_buckets": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables5": 1, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "has_v5_rules": 0, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: "has_msr_rules": 0 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.220 INFO:tasks.workunit.client.0.trial109.stderr:report 2314694738 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "choose_args": {} 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "fsmap": { 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "btime": "2026-02-19T12:36:54:977974+0000", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "default_fscid": -1, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "compat": { 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "compat": {}, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "ro_compat": {}, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "incompat": { 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_1": "base v0.20", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_2": "client writeable ranges", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_4": "dir inode in separate object", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_8": "no anchor table", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_9": "file layout v2", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_10": "snaprealm v2", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_11": "minor log segments", 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "feature_flags": { 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "enable_multiple": true, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "ever_enabled_multiple": true 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "standbys": [], 2026-02-19T12:38:08.221 INFO:tasks.workunit.client.0.trial109.stdout: "filesystems": [] 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_first_committed": 1, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_last_committed": 1, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "auth": { 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 5, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_secrets": 3 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_active": 1, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_unknown": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_osd": 3, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "pool_sum": { 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51200, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 100, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 100, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:38:08.222 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 16, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 16, 2026-02-19T12:38:08.223 INFO:tasks.workunit.client.0.trial109.stdout: "up": 2, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 2, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 0 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum": { 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83864, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2080, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 26, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81701, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488936, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036670464, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2129920, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 426820, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 26705, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83662767 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:38:08.224 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum_by_class": { 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "ssd": { 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83864, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2080, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 26, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81701, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488936, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036670464, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2129920, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 426820, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:08.225 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 26705, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83662767 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "pool_stats": [ 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51200, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:38:08.226 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 100, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 100, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:38:08.227 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 1220608, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 153552, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 16, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 16, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "up": 2, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 2, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 3 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "osd_stats": [ 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 150323855369 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 38654705676 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 158913789961 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_state": [ 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded", 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: "num": 1 2026-02-19T12:38:08.228 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "pool_pg_unavailable_map": [ 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": "1", 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "pgs": [] 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_osd": [ 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 1, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 0, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": [ 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": {} 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "servicemap": { 2026-02-19T12:38:08.229 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 3, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:38:03.657803+0000", 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "services": { 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "osd": { 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "daemons": { 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "summary": "", 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "0": { 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "2": { 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_first_committed": 1, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_last_committed": 37, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "logm_first_committed": 1, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "logm_last_committed": 209, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "paxos": { 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 296, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "last_pn": 0, 2026-02-19T12:38:08.230 INFO:tasks.workunit.client.0.trial109.stdout: "accepted_pn": 0 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stdout:writing non-divergent object existing_4 2026-02-19T12:38:08.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:08.400 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:08.400 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:37:37.460333+0000 28'100 40:135 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:29:58.552032+0000 0 0 2026-02-19T12:38:08.400 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:08.400 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:08.400 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:08.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.DvDs6O770O 2026-02-19T12:38:08.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.DvDs6O770O 2026-02-19T12:38:08.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:38:08.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-19T12:38:08.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:38:08.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:38:08.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:38:08.441 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:38:08.442 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:38:08.442 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:38:08.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:38:08.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:38:08.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:38:08.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:38:08.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:38:08.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:38:08.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:38:08.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:38:08.513 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:38:08.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:38:08.733 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:38:08.733 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:38:08.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:38:08.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:38:08.733 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:38:08.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-19T12:38:08.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-19T12:38:08.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855371' 2026-02-19T12:38:08.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:38:08.814 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:38:08.876 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:38:08.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:38:08.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:38:08.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:38:08.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:38:08.880 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:38:08.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-19T12:38:08.961 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-19T12:38:08.961 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855371 2-158913789963' 2026-02-19T12:38:08.961 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:38:08.961 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-19T12:38:08.961 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:38:08.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:38:08.963 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-150323855371 2026-02-19T12:38:08.963 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:38:08.965 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855371 2026-02-19T12:38:08.965 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-19T12:38:08.965 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 150323855371 2026-02-19T12:38:08.965 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:38:09.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-19T12:38:09.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:38:10.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:38:10.183 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:38:10.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-19T12:38:10.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:38:10.401 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789963 2026-02-19T12:38:10.401 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:38:10.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:38:10.403 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-158913789963 2026-02-19T12:38:10.403 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:38:10.404 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789963 2026-02-19T12:38:10.404 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 158913789963 2026-02-19T12:38:10.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 158913789963' 2026-02-19T12:38:10.405 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:38:10.633 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-19T12:38:10.634 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:38:10.634 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:10.634 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:10.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:38:10.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:10.923 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:10.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:10.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:10.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:10.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:10.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:11.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:11.139 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:11.139 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:11.139 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:11.430 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:11.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T12:38:11.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T12:38:11.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T12:38:11.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:11.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T12:38:11.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:11.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:11.533 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:11.533 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:11.533 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:11.533 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:11.533 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:11.533 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:11.748 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:11.749 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:11.749 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:11.749 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:12.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:12.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:12.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:12.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:12.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T12:38:12.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:12.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T12:38:12.525 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:12.525 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:12.526 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:12.526 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:12.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:12.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:12.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:12.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:12.740 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:12.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:12.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:12.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:13.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:13.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:13.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:13.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:13.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:13.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:13.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:13.032 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:13.032 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:13.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:13.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:13.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T12:38:13.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:13.316 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T12:38:13.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:13.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:13.718 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:13.718 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:13.718 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:13.718 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:13.719 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:13.719 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:13.931 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:13.932 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:13.932 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:13.932 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:14.212 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:14.212 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:14.212 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:14.212 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:14.213 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:14.213 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:14.213 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:14.213 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:14.213 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:14.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:14.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:14.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T12:38:14.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:14.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T12:38:15.285 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:15.286 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:15.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:15.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:15.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:15.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:15.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:15.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:15.493 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:15.493 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:15.494 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:15.494 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:15.767 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:15.768 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:16.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:16.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:16.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T12:38:16.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:16.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T12:38:17.642 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:17.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:17.643 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:17.643 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:17.643 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:17.643 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:17.644 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:17.644 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:17.850 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:17.850 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:17.851 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:17.851 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:18.136 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:18.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:18.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:18.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T12:38:18.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:18.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T12:38:21.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:21.626 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:21.626 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:21.626 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:21.626 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:21.626 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:21.627 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:21.627 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:21.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:21.846 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:21.846 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:21.847 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:22.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:22.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:22.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:22.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:22.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:22.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:22.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:22.135 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:22.135 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:22.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:22.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:22.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T12:38:22.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:22.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T12:38:28.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:28.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:28.824 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:28.825 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:28.825 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:28.825 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:28.825 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:28.825 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:29.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:29.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:29.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:29.038 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:29.324 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:29.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:29.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:29.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T12:38:29.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:38:29.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T12:38:36.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:38:36.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:38:36.916 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:38:36.916 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:38:36.916 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:38:36.916 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:38:36.917 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:38:36.917 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:38:37.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:38:37.132 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:38:37.132 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:38:37.133 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:38:37.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:38:37.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:38:37.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:38:37.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:38:37.421 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:38:37.421 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:38:37.421 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:38:37.421 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:38:37.421 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:38:37.711 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:38:37.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:38:37.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T12:38:37.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T12:38:37.980 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:38:37.980 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_fingerprint": "0223ca32-5be1-4691-b4bb-7826f3d02e1f", 2026-02-19T12:38:37.980 INFO:tasks.workunit.client.0.trial109.stdout: "version": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:37.980 INFO:tasks.workunit.client.0.trial109.stdout: "commit": "2fc421c83f0b86ea21b9e4289cad0f7957e09eb1", 2026-02-19T12:38:37.980 INFO:tasks.workunit.client.0.trial109.stdout: "timestamp": "2026-02-19T12:38:37.972064+0000", 2026-02-19T12:38:37.980 INFO:tasks.workunit.client.0.trial109.stdout: "tag": "", 2026-02-19T12:38:37.980 INFO:tasks.workunit.client.0.trial109.stdout: "health": { 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "status": "HEALTH_WARN", 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "checks": { 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "OSDMAP_FLAGS": { 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "count": 17 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [], 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.981 INFO:tasks.workunit.client.0.trial109.stdout: "OSD_DOWN": { 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: "message": "1 osds down", 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: "message": "osd.1 (root=default,host=trial109) is down" 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:38:37.982 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: "PG_DEGRADED": { 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded, 1 pg undersized", 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: "count": 2 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.0 is stuck undersized for 60s, current state active+undersized+degraded, last acting [0,2]" 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:37.983 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "mutes": [] 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_first_committed": 1, 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_last_committed": 1, 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "monmap": { 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:36:54.897994Z", 2026-02-19T12:38:37.984 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:36:54.897994Z", 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release": 20, 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release_name": "tentacle", 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "election_strategy": 1, 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "disallowed_leaders": "", 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": false, 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "tiebreaker_mon": "", 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "removed_ranks": "", 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "features": { 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "persistent": [ 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "kraken", 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "luminous", 2026-02-19T12:38:37.985 INFO:tasks.workunit.client.0.trial109.stdout: "mimic", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap-prune", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "nautilus", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "octopus", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "pacific", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "elector-pinging", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "quincy", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "reef", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "squid", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "tentacle", 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "nvmeof_beacon_diff" 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: "optional": [] 2026-02-19T12:38:37.986 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "mons": [ 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "rank": 0, 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "name": "a", 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115", 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 0 2026-02-19T12:38:37.987 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: "priority": 0, 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 0, 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: "crush_location": "{}" 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: "quorum": [ 2026-02-19T12:38:37.988 INFO:tasks.workunit.client.0.trial109.stdout: 0 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap": { 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 40, 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:36:54.978197+0000", 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:37:37.456330+0000", 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "last_up_change": "2026-02-19T12:37:36.498253+0000", 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "last_in_change": "2026-02-19T12:37:37.353933+0000", 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "flags_num": 5800384, 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "flags_set": [ 2026-02-19T12:38:37.989 INFO:tasks.workunit.client.0.trial109.stdout: "nodown", 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "noin", 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "noout", 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "pglog_hardlimit", 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snapdirs", 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "recovery_deletes", 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "sortbitwise" 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "crush_version": 9, 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_snapshot": "", 2026-02-19T12:38:37.990 INFO:tasks.workunit.client.0.trial109.stdout: "pool_max": 1, 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "max_osd": 3, 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "require_min_compat_client": "luminous", 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "min_compat_client": "jewel", 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "require_osd_release": "tentacle", 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "allow_crimson": false, 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "pools": [ 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "pool_name": "test", 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "create_time": "2026-02-19T12:37:06.084619+0000", 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "flags": 1, 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "flags_names": "hashpspool", 2026-02-19T12:38:37.991 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "size": 3, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "min_size": 2, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "crush_rule": 0, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_count": 0, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_target": 0, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "is_stretch_pool": false, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "object_hash": 2, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "pg_autoscale_mode": "off", 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num": 1, 2026-02-19T12:38:37.992 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num": 1, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num_target": 1, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_target": 1, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_pending": 1, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "last_pg_merge_meta": { 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "source_pgid": "0.0", 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "ready_epoch": 0, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_started": 0, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": 0, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "source_version": "0'0", 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "target_version": "0'0" 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "last_change": "26", 2026-02-19T12:38:37.993 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend": "0", 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "auid": 0, 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "snap_mode": "selfmanaged", 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "snap_seq": 0, 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "snap_epoch": 0, 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "pool_snaps": [], 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps": "[]", 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_bytes": 0, 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_objects": 0, 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "tiers": [], 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "tier_of": -1, 2026-02-19T12:38:37.994 INFO:tasks.workunit.client.0.trial109.stdout: "read_tier": -1, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "write_tier": -1, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "cache_mode": "none", 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_bytes": 0, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_objects": 0, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_flush_age": 0, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_evict_age": 0, 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profile": "", 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_params": { 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: "type": "none" 2026-02-19T12:38:37.995 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_period": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_count": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "use_gmt_hitset": true, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "min_read_recency_for_promote": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "min_write_recency_for_promote": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_search_last_n": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "grade_table": [], 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "stripe_width": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "expected_num_objects": 0, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "fast_read": false, 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "nonprimary_shards": "{}", 2026-02-19T12:38:37.996 INFO:tasks.workunit.client.0.trial109.stdout: "options": {}, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "application_metadata": {}, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "read_balance": { 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "score_type": "Fair distribution", 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "score_acting": 2.9900000095367432, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "score_stable": 2.9900000095367432, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_acting": 2, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_stable": 2, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity_weighted": 1, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity": 1, 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity_weighted": 1 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:37.997 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "osds": [ 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "bf32bfdc-a98f-436c-83dc-e5b882f863dc", 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 5, 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 28, 2026-02-19T12:38:37.998 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 35, 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 39, 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 29, 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6802", 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:37.999 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6803", 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6804", 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:38.000 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6805", 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6808", 2026-02-19T12:38:38.001 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6809", 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.002 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6806", 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6807", 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2791137565 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6803/2791137565", 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6805/2791137565", 2026-02-19T12:38:38.003 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2791137565", 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2791137565", 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "298f2f2e-5379-4beb-bdcc-e76e8800f353", 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "up": 0, 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:38:38.004 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 0, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 0, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 9, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 20, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 30, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.005 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.006 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:38:38.007 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.008 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2158933337 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.009 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/2158933337", 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/2158933337", 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2158933337", 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2158933337", 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "exists" 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08", 2026-02-19T12:38:38.010 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 13, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 28, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 37, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 0, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 31, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.011 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.012 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.013 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.014 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 6555484 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/6555484", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/6555484", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/6555484", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/6555484", 2026-02-19T12:38:38.015 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "osd_xinfo": [ 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:37:32.144317+0000", 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:38:38.016 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:36:58.449685+0000", 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:37:32.420046+0000", 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:37:02.478311+0000", 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.017 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:37:32.711092+0000", 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:37:05.329101+0000", 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap": [], 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_items": [], 2026-02-19T12:38:38.018 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_primaries": [], 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "pg_temp": [], 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "primary_temp": [], 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "blocklist": {}, 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "range_blocklist": {}, 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profiles": { 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "default": { 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "m": "2", 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps_queue": [], 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "new_removed_snaps": [], 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "new_purged_snaps": [], 2026-02-19T12:38:38.019 INFO:tasks.workunit.client.0.trial109.stdout: "crush_node_flags": {}, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "device_class_flags": {}, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": { 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_enabled": false, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_bucket_count": 0, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "degraded_stretch_mode": 0, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "recovering_stretch_mode": 0, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_bucket": 0 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "osd_metadata": [ 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6804/2791137565,v1:127.0.0.1:6805/2791137565]", 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:38:38.020 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:38:38.021 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:36:55.992449Z", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:38:38.022 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6802/2791137565,v1:127.0.0.1:6803/2791137565]", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2791137565,v1:127.0.0.1:6809/2791137565]", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2791137565,v1:127.0.0.1:6807/2791137565]", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:38:38.023 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/2158933337,v1:127.0.0.1:6813/2158933337]", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:38:38.024 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:37:00.102495Z", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:38:38.025 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/2158933337,v1:127.0.0.1:6811/2158933337]", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2158933337,v1:127.0.0.1:6817/2158933337]", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2158933337,v1:127.0.0.1:6815/2158933337]", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:38:38.026 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/6555484,v1:127.0.0.1:6813/6555484]", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:38:38.027 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:37:02.939809Z", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:38:38.028 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/6555484,v1:127.0.0.1:6811/6555484]", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/6555484,v1:127.0.0.1:6817/6555484]", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/6555484,v1:127.0.0.1:6815/6555484]", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.029 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_clean_epochs": { 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "min_last_epoch_clean": 24, 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": { 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "per_pool": [ 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "floor": 24 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "osd_epochs": [ 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 35 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 38 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.030 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_first_committed": 1, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_last_committed": 40, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "crushmap": { 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "devices": [ 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.0", 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.1", 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.2", 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.031 INFO:tasks.workunit.client.0.trial109.stdout: "types": [ 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 0, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd" 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "name": "host" 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 2, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "name": "chassis" 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 3, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "name": "rack" 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 4, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: "name": "row" 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.032 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 5, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pdu" 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 6, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pod" 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 7, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "name": "room" 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 8, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "name": "datacenter" 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 9, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "name": "zone" 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 10, 2026-02-19T12:38:38.033 INFO:tasks.workunit.client.0.trial109.stdout: "name": "region" 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "name": "root" 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "buckets": [ 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "id": -1, 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default", 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.034 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "id": -2, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default~ssd", 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109", 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:38:38.035 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109~ssd", 2026-02-19T12:38:38.036 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.037 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "rules": [ 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 0, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "replicated_rule", 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_firstn", 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "tunables": { 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_tries": 0, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_fallback_tries": 0, 2026-02-19T12:38:38.038 INFO:tasks.workunit.client.0.trial109.stdout: "choose_total_tries": 50, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_descend_once": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_vary_r": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_stable": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "msr_descents": 100, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "msr_collision_tries": 100, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "straw_calc_version": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "allowed_bucket_algs": 54, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "profile": "jewel", 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_tunables": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "legacy_tunables": 0, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "minimum_required_version": "jewel", 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables2": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "has_v2_rules": 0, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables3": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "has_v3_rules": 0, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "has_v4_buckets": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables5": 1, 2026-02-19T12:38:38.039 INFO:tasks.workunit.client.0.trial109.stderr:report 1818333015 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "has_v5_rules": 0, 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "has_msr_rules": 0 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "choose_args": {} 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "fsmap": { 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "btime": "2026-02-19T12:36:54:977974+0000", 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "default_fscid": -1, 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "compat": { 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "compat": {}, 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "ro_compat": {}, 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "incompat": { 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "feature_1": "base v0.20", 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "feature_2": "client writeable ranges", 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "feature_4": "dir inode in separate object", 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T12:38:38.040 INFO:tasks.workunit.client.0.trial109.stdout: "feature_8": "no anchor table", 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "feature_9": "file layout v2", 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "feature_10": "snaprealm v2", 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "feature_11": "minor log segments", 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "feature_flags": { 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "enable_multiple": true, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "ever_enabled_multiple": true 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "standbys": [], 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "filesystems": [] 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_first_committed": 1, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_last_committed": 1, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "auth": { 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 5, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "num_secrets": 3 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_active": 1, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_unknown": 0, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "num_osd": 3, 2026-02-19T12:38:38.041 INFO:tasks.workunit.client.0.trial109.stdout: "pool_sum": { 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51688, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:38:38.042 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 17, 2026-02-19T12:38:38.043 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 17, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "up": 2, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 2, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 0 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum": { 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83864, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2080, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 26, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81701, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488936, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036670464, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2129920, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 427796, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 26705, 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83662767 2026-02-19T12:38:38.044 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum_by_class": { 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "ssd": { 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83864, 2026-02-19T12:38:38.045 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2080, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 26, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81701, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488936, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036670464, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2129920, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 427796, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 26705, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83662767 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:38:38.046 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "pool_stats": [ 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51688, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:38:38.047 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 1220608, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 154528, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 17, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 17, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "up": 2, 2026-02-19T12:38:38.048 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 2, 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 3 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "osd_stats": [ 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 150323855377 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 38654705676 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 158913789969 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_state": [ 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded", 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "num": 1 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "pool_pg_unavailable_map": [ 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": "1", 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "pgs": [] 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_osd": [ 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.049 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 1, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 0, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": [ 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": {} 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "servicemap": { 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 5, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:38:37.661307+0000", 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "services": {} 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_first_committed": 1, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_last_committed": 52, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "logm_first_committed": 1, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "logm_last_committed": 270, 2026-02-19T12:38:38.050 INFO:tasks.workunit.client.0.trial109.stdout: "paxos": { 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 372, 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stdout: "last_pn": 0, 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stdout: "accepted_pn": 0 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-19T12:38:38.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:38.201 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:38.201 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:37:37.460333+0000 40'101 40:136 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:29:58.552032+0000 0 0 2026-02-19T12:38:38.201 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:38.201 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:38.201 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:38.210 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:38:38.210 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-19T12:38:38.210 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:38:38.210 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:38:38.211 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:38:38.211 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:38:38.211 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:38:38.212 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:38:38.212 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-19T12:38:38.212 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T12:38:38.267 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:38:38.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-19T12:38:38.274 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-19T12:38:38.274 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:38:38.274 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:38:38.274 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:38:38.274 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:38:38.275 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:38:38.275 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:38:38.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-19T12:38:38.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T12:38:38.327 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:38:38.333 INFO:tasks.workunit.client.0.trial109.stdout:revive divergent 1 2026-02-19T12:38:38.333 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-19T12:38:38.333 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:38.541 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:38.541 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:37:37.460333+0000 40'101 40:136 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:29:58.552032+0000 0 0 2026-02-19T12:38:38.541 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:38.541 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:38.541 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:38.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-19T12:38:38.876 INFO:tasks.workunit.client.0.trial109.stderr:noup is set 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:38:38.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:38:38.888 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:38:38.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:38:38.890 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:38:38.890 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:38:38.890 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:38:38.891 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:38:38.892 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:38:38.892 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:38:38.892 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:38:38.892 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:38:38.913 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:38.901+0000 7fc7751b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:38:38.915 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:38.901+0000 7fc7751b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:38:38.916 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:38.905+0000 7fc7751b0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:38:39.113 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T12:38:39.113 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-19T12:38:39.229 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:39.217+0000 7fc7751b0a40 -1 Falling back to public interface 2026-02-19T12:38:39.829 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:39.817+0000 7fc7751b0a40 -1 osd.1 28 log_to_monitors true 2026-02-19T12:38:44.115 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery divergent 2026-02-19T12:38:44.116 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-19T12:38:44.116 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:44.312 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:44.312 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:37:37.460333+0000 40'101 42:140 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:29:58.552032+0000 0 0 2026-02-19T12:38:44.313 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:44.313 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:44.313 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:44.321 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-19T12:38:44.322 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:38:44.322 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:38:44.322 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:38:44.322 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:38:44.322 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:38:44.322 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:38:44.323 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-19T12:38:44.323 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T12:38:44.375 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:38:44.381 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-19T12:38:44.706 INFO:tasks.workunit.client.0.trial109.stderr:noup is unset 2026-02-19T12:38:44.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-19T12:38:44.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:38:44.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:38:44.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:38:44.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:38:44.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:38:44.719 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:38:44.719 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:38:44.719 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:38:44.719 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:38:44.931 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 35 up_thru 39 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6802/2791137565,v1:127.0.0.1:6803/2791137565] [v2:127.0.0.1:6804/2791137565,v1:127.0.0.1:6805/2791137565] exists,up bf32bfdc-a98f-436c-83dc-e5b882f863dc 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:38:44.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:38:44.934 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:38:44.934 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:38:44.934 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:38:44.934 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:38:45.138 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1909001076,v1:127.0.0.1:6819/1909001076] [v2:127.0.0.1:6820/1909001076,v1:127.0.0.1:6821/1909001076] exists,up 298f2f2e-5379-4beb-bdcc-e76e8800f353 2026-02-19T12:38:45.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:38:45.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:38:45.141 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:38:45.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:38:45.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:38:45.347 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/6555484,v1:127.0.0.1:6811/6555484] [v2:127.0.0.1:6812/6555484,v1:127.0.0.1:6813/6555484] exists,up 44ddc9b4-10ad-4a5c-bd98-c3f4de9a9a08 2026-02-19T12:38:45.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:38:45.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:38:45.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:38:45.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:45.544 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:45.544 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:37:37.460333+0000 40'101 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:29:58.552032+0000 0 0 2026-02-19T12:38:45.544 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:45.544 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:45.544 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:45.553 INFO:tasks.workunit.client.0.trial109.stdout:wait for peering 2026-02-19T12:38:45.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-19T12:38:45.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:45.765 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:45.765 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-19T12:38:44.807215+0000 40'101 46:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:38:45.765 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:45.765 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:45.765 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:45.774 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.BMKfK1AavN 2026-02-19T12:38:45.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.BMKfK1AavN 2026-02-19T12:38:45.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-19T12:38:45.805 INFO:tasks.workunit.client.0.trial109.stdout:killing divergent 1 2026-02-19T12:38:45.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:46.020 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:46.020 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-19T12:38:44.807215+0000 40'101 46:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:38:46.020 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:46.020 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:46.020 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:46.030 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T12:38:46.030 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:38:46.030 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:38:46.030 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:38:46.030 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:38:46.030 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.16056.out 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16056.out 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T12:38:46.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16056.out 2026-02-19T12:38:46.347 INFO:tasks.workunit.client.0.trial109.stderr:Exporting 1.0 info 1.0( v 46'102 lc 0'0 (28'90,46'102] local-lis/les=45/46 n=101 ec=20/20 lis/c=45/20 les/c/f=46/21/0 sis=45) 2026-02-19T12:38:46.348 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-19T12:38:46.348 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-19T12:38:46.348 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-19T12:38:46.348 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-19T12:38:46.348 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-19T12:38:46.349 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-19T12:38:46.349 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-19T12:38:46.349 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:169157fa:::existing_81:head# 2026-02-19T12:38:46.349 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:17731382:::existing_58:head# 2026-02-19T12:38:46.349 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-19T12:38:46.349 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:28566edb:::existing_78:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:2a101182:::existing_20:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-19T12:38:46.350 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-19T12:38:46.351 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-19T12:38:46.351 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-19T12:38:46.351 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-19T12:38:46.351 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-19T12:38:46.351 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-19T12:38:46.351 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-19T12:38:46.351 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-19T12:38:46.352 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:53588912:::existing_9:head# 2026-02-19T12:38:46.352 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-19T12:38:46.352 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-19T12:38:46.352 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-19T12:38:46.352 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-19T12:38:46.352 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:602f83fe:::foo:head# 2026-02-19T12:38:46.352 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:628918ca:::existing_79:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-19T12:38:46.353 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-19T12:38:46.354 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:750ace21:::existing_19:head# 2026-02-19T12:38:46.354 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-19T12:38:46.354 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:79881152:::existing_63:head# 2026-02-19T12:38:46.354 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-19T12:38:46.354 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:81490677:::existing_76:head# 2026-02-19T12:38:46.354 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:92731e71:::existing_89:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:928205cf:::existing_82:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:93be2267:::existing_24:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-19T12:38:46.355 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-19T12:38:46.356 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-19T12:38:46.356 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-19T12:38:46.356 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:a504a533:::existing_90:head# 2026-02-19T12:38:46.356 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:a691337e:::existing_61:head# 2026-02-19T12:38:46.356 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-19T12:38:46.356 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-19T12:38:46.356 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:b343e277:::existing_88:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-19T12:38:46.357 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:bebec877:::existing_74:head# 2026-02-19T12:38:46.358 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-19T12:38:46.358 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:c156033e:::existing_100:head# 2026-02-19T12:38:46.358 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-19T12:38:46.358 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-19T12:38:46.358 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-19T12:38:46.358 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-19T12:38:46.358 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-19T12:38:46.359 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-19T12:38:46.359 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-19T12:38:46.359 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-19T12:38:46.359 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-19T12:38:46.359 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-19T12:38:46.359 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-19T12:38:46.359 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-19T12:38:46.360 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-19T12:38:46.360 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-19T12:38:46.360 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:e255b710:::existing_55:head# 2026-02-19T12:38:46.360 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-19T12:38:46.360 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-19T12:38:46.360 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-19T12:38:46.361 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:f6809456:::existing_11:head# 2026-02-19T12:38:46.361 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-19T12:38:46.361 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-19T12:38:46.361 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-19T12:38:46.361 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-19T12:38:46.361 INFO:tasks.workunit.client.0.trial109.stderr:Export successful 2026-02-19T12:38:46.362 INFO:tasks.workunit.client.0.trial109.stdout: marking collection for removal 2026-02-19T12:38:46.362 INFO:tasks.workunit.client.0.trial109.stdout:setting '_remove' omap key 2026-02-19T12:38:46.362 INFO:tasks.workunit.client.0.trial109.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-19T12:38:46.362 INFO:tasks.workunit.client.0.trial109.stderr:Remove successful 2026-02-19T12:38:46.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16056.out 2026-02-19T12:38:46.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T12:38:46.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T12:38:46.477 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T12:38:46.477 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T12:38:46.477 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T12:38:46.477 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16056.out 2026-02-19T12:38:46.680 INFO:tasks.workunit.client.0.trial109.stdout:get_pg_num_history pg_num_history pg_num_history(e46 pg_nums {1={20=1}} deleted_pools ) 2026-02-19T12:38:46.680 INFO:tasks.workunit.client.0.trial109.stdout:Importing pgid 1.0 2026-02-19T12:38:46.680 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-19T12:38:46.680 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.680 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-19T12:38:46.680 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:169157fa:::existing_81:head# 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.681 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:17731382:::existing_58:head# 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:28566edb:::existing_78:head# 2026-02-19T12:38:46.682 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:2a101182:::existing_20:head# 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-19T12:38:46.683 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:53588912:::existing_9:head# 2026-02-19T12:38:46.684 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:602f83fe:::foo:head# 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-19T12:38:46.685 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:628918ca:::existing_79:head# 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-19T12:38:46.686 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:750ace21:::existing_19:head# 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:79881152:::existing_63:head# 2026-02-19T12:38:46.687 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:81490677:::existing_76:head# 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.688 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:92731e71:::existing_89:head# 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:928205cf:::existing_82:head# 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:93be2267:::existing_24:head# 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-19T12:38:46.689 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:a504a533:::existing_90:head# 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:a691337e:::existing_61:head# 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.690 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:b343e277:::existing_88:head# 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-19T12:38:46.691 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:bebec877:::existing_74:head# 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:c156033e:::existing_100:head# 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.692 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-19T12:38:46.693 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-19T12:38:46.694 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:e255b710:::existing_55:head# 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:f6809456:::existing_11:head# 2026-02-19T12:38:46.695 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:38:46.696 INFO:tasks.workunit.client.0.trial109.stdout:write_pg epoch 46 info 1.0( v 46'102 lc 0'0 (28'90,46'102] local-lis/les=45/46 n=101 ec=20/20 lis/c=45/20 les/c/f=46/21/0 sis=45) 2026-02-19T12:38:46.697 INFO:tasks.workunit.client.0.trial109.stdout:Import successful 2026-02-19T12:38:46.800 INFO:tasks.workunit.client.0.trial109.stdout:reviving divergent 1 2026-02-19T12:38:46.801 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-19T12:38:46.801 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:38:47.002 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:38:47.002 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-19T12:38:44.807215+0000 40'101 46:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:38:47.002 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:38:47.002 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:38:47.002 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:38:47.011 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-19T12:38:47.011 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:38:47.011 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:38:47.012 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:38:47.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:38:47.014 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:38:47.014 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:38:47.015 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:38:47.016 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:38:47.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:38:47.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:38:47.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:38:47.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:38:47.043 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:47.032+0000 7f892435ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:38:47.045 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:47.036+0000 7f892435ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:38:47.046 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:47.036+0000 7f892435ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:38:47.225 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:38:47.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:38:47.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:38:47.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:38:47.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:38:47.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:38:47.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:38:47.227 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:38:47.227 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:38:47.227 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:38:47.426 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:47.416+0000 7f892435ea40 -1 Falling back to public interface 2026-02-19T12:38:47.438 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1909001076,v1:127.0.0.1:6819/1909001076] [v2:127.0.0.1:6820/1909001076,v1:127.0.0.1:6821/1909001076] exists,up 298f2f2e-5379-4beb-bdcc-e76e8800f353 2026-02-19T12:38:47.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:38:47.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:38:47.441 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:38:47.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:38:47.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:38:47.655 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1909001076,v1:127.0.0.1:6819/1909001076] [v2:127.0.0.1:6820/1909001076,v1:127.0.0.1:6821/1909001076] exists,up 298f2f2e-5379-4beb-bdcc-e76e8800f353 2026-02-19T12:38:47.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:38:47.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:38:47.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:38:47.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-19T12:38:48.107 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:38:48.096+0000 7f892435ea40 -1 osd.1 46 log_to_monitors true 2026-02-19T12:39:07.658 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-19T12:39:07.658 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:39:07.658 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:39:07.659 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:39:07.659 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:07.659 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:07.660 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:39:07.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-19T12:39:07.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.1.asok dump_ops_in_flight 2026-02-19T12:39:07.722 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:39:07.722 INFO:tasks.workunit.client.0.trial109.stdout: "ops": [], 2026-02-19T12:39:07.722 INFO:tasks.workunit.client.0.trial109.stdout: "num_ops": 0 2026-02-19T12:39:07.722 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:39:07.728 INFO:tasks.workunit.client.0.trial109.stdout:allowing recovery 2026-02-19T12:39:07.728 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-19T12:39:07.728 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:39:07.935 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:39:07.935 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-19T12:38:49.869285+0000 46'102 50:167 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:42:35.781609+0000 0 0 2026-02-19T12:39:07.935 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:39:07.935 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:39:07.935 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:39:07.946 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-19T12:39:07.946 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T12:39:08.020 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:39:08.028 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-19T12:39:08.028 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T12:39:08.114 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:39:08.121 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-19T12:39:08.121 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T12:39:08.201 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:39:08.208 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-19T12:39:08.208 INFO:tasks.workunit.client.0.trial109.stdout:reading divergent objects 2026-02-19T12:39:08.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-19T12:39:08.418 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:39:08.418 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-19T12:38:49.869285+0000 46'102 50:167 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:37:06.107414+0000 0'0 2026-02-19T12:37:06.107414+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:42:35.781609+0000 0 0 2026-02-19T12:39:08.418 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:39:08.419 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:39:08.419 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:39:08.428 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-19T12:39:08.429 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-19T12:39:08.430 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:39:08.430 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T12:39:08.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:39:08.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T12:39:08.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:39:08.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T12:39:08.507 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:39:08.507 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T12:39:08.536 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-19T12:39:08.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:39:08.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-19T12:39:08.556 INFO:tasks.workunit.client.0.trial109.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-19T12:39:08.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:39:08.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-19T12:39:08.584 INFO:tasks.workunit.client.0.trial109.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-19T12:39:08.587 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-19T12:39:08.588 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-19T12:39:08.590 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-19T12:37:21.566895+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-19T12:37:21.566895+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: more recent entry found: 40'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-19T12:38:08.432214+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-19T12:37:21.560789+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-19T12:37:21.560789+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4544.0:1 2026-02-19T12:37:21.564623+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4544.0:1 2026-02-19T12:37:21.564623+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4544.0:1 2026-02-19T12:37:21.564623+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'90 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-19T12:37:21.563204+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:39:08.593 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: keeping 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-19T12:37:21.563204+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-19T12:37:21.563204+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'90 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-19T12:37:21.562308+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: keeping 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-19T12:37:21.562308+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-19T12:37:21.562308+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4537.0:1 2026-02-19T12:37:21.561172+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4537.0:1 2026-02-19T12:37:21.561172+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:39:08.594 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:39:08.595 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-19T12:39:08.595 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-19T12:39:08.595 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:38:44.801+0000 7fc75292d640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-19T12:39:08.595 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-19T12:39:08.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:39:08.598 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-19T12:39:08.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:39:08.601 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-19T12:39:08.601 INFO:tasks.workunit.client.0.trial109.stdout:success 2026-02-19T12:39:08.601 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.16056.out 2026-02-19T12:39:08.602 INFO:tasks.workunit.client.0.trial109.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16056.out': No such file or directory 2026-02-19T12:39:08.602 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-19T12:39:08.602 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T12:39:08.602 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T12:39:08.858 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' does not exist 2026-02-19T12:39:08.868 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-19T12:39:08.869 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:39:08.869 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:39:08.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:39:08.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:39:08.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:39:14.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:39:14.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T12:39:14.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:39:14.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:39:14.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:39:14.186 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:39:14.186 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:39:14.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:39:14.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:39:14.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:39:14.193 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:39:14.193 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:39:14.194 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:39:14.194 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:39:14.196 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:39:14.196 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:39:14.196 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:39:14.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:39:14.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:39:14.198 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:39:14.198 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:39:14.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:39:14.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:39:14.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:39:14.220 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:39:14.221 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.221 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:39:14.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:39:14.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:39:14.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T12:39:14.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T12:39:14.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T12:39:14.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T12:39:14.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:39:14.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:39:14.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:39:14.224 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:39:14.224 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:39:14.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:39:14.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:39:14.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:39:14.225 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:39:14.225 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:39:14.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:39:14.227 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:39:14.228 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:39:14.228 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:39:14.229 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:39:14.229 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:39:14.230 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:39:14.230 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:39:14.230 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:39:14.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:39:14.232 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:39:14.232 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:39:14.234 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:39:14.234 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.234 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.235 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:39:14.236 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:39:14.236 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:39:14.236 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T12:39:14.237 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:39:14.237 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.238 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.238 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16056 2026-02-19T12:39:14.238 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-19T12:39:14.240 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-19T12:39:14.241 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.omb2QIlYmB 2026-02-19T12:39:14.241 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.omb2QIlYmB bs=512 count=1 2026-02-19T12:39:14.242 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:39:14.242 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:39:14.242 INFO:tasks.workunit.client.0.trial109.stderr:512 bytes copied, 8.9264e-05 s, 5.7 MB/s 2026-02-19T12:39:14.242 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:14.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.omb2QIlYmB 2026-02-19T12:39:14.243 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-19T12:39:14.243 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-19T12:39:14.243 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-19T12:39:14.244 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.xJAogCLnU3 2026-02-19T12:39:14.244 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.xJAogCLnU3 bs=1000 count=1 2026-02-19T12:39:14.245 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:39:14.245 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:39:14.245 INFO:tasks.workunit.client.0.trial109.stderr:1000 bytes (1.0 kB) copied, 5.3759e-05 s, 18.6 MB/s 2026-02-19T12:39:14.245 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.xJAogCLnU3 2026-02-19T12:39:14.246 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.xJAogCLnU3 2026-02-19T12:39:14.246 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-19T12:39:14.246 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-19T12:39:14.246 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-19T12:39:14.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-19T12:39:14.248 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:39:14.248 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:39:14.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-19T12:39:14.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T12:39:14.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:39:14.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:39:14.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:39:14.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T12:39:14.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T12:39:14.276 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:39:14.276 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:39:14.276 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:39:14.276 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:39:14.276 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.276 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.276 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:14.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:39:14.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:39:14.309 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:39:14.310 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:39:14.310 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:39:14.310 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:39:14.310 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:39:14.310 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:39:14.311 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:39:14.311 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:39:14.312 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:39:14.313 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.313 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.313 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:39:14.313 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:39:14.313 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get fsid 2026-02-19T12:39:14.368 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:39:14.368 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:39:14.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:39:14.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:39:14.369 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:39:14.369 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:39:14.369 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:39:14.369 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:39:14.370 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:39:14.370 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.370 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.370 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:39:14.370 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:39:14.370 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get mon_host 2026-02-19T12:39:14.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-19T12:39:14.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T12:39:14.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:39:14.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:39:14.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:39:14.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T12:39:14.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:39:14.546 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:39:14.546 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:39:14.547 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:39:14.547 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:39:14.547 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.547 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.547 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:14.547 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:39:14.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:39:14.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:39:14.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:14.572 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:39:14.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:39:14.574 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:39:14.574 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:39:14.574 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=622d3a9f-6590-4503-8abc-1d26518e854d 2026-02-19T12:39:14.575 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 622d3a9f-6590-4503-8abc-1d26518e854d 2026-02-19T12:39:14.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 622d3a9f-6590-4503-8abc-1d26518e854d' 2026-02-19T12:39:14.575 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:39:14.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQByBJdpdQNYIhAAWogRWUmZFMpdAC4AfPULHw== 2026-02-19T12:39:14.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQByBJdpdQNYIhAAWogRWUmZFMpdAC4AfPULHw=="}' 2026-02-19T12:39:14.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 622d3a9f-6590-4503-8abc-1d26518e854d -i td/divergent-priors/0/new.json 2026-02-19T12:39:14.702 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:39:14.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T12:39:14.714 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQByBJdpdQNYIhAAWogRWUmZFMpdAC4AfPULHw== --osd-uuid 622d3a9f-6590-4503-8abc-1d26518e854d 2026-02-19T12:39:14.734 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:14.723+0000 7f3b69b1ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:14.736 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:14.723+0000 7f3b69b1ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:14.737 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:14.727+0000 7f3b69b1ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:14.737 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:14.727+0000 7f3b69b1ca40 -1 bdev(0x55b9c8462c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:39:14.738 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:14.727+0000 7f3b69b1ca40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T12:39:15.528 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T12:39:15.528 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:39:15.528 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:39:15.529 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:39:15.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:39:15.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:39:15.822 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:39:15.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:39:15.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:39:15.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:39:15.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:39:15.852 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:15.839+0000 7fcefa064a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:15.853 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:15.843+0000 7fcefa064a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:15.855 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:15.843+0000 7fcefa064a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:16.039 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:39:16.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:39:16.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:39:16.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:39:16.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:39:16.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:16.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:39:16.040 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:39:16.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:16.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:39:16.206 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:16.195+0000 7fcefa064a40 -1 Falling back to public interface 2026-02-19T12:39:16.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:39:16.795 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:16.783+0000 7fcefa064a40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:39:17.258 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:39:17.258 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:17.259 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:39:17.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:39:17.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:17.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:39:17.469 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3737391875,v1:127.0.0.1:6803/3737391875] [v2:127.0.0.1:6804/3737391875,v1:127.0.0.1:6805/3737391875] exists,up 622d3a9f-6590-4503-8abc-1d26518e854d 2026-02-19T12:39:17.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:39:17.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:39:17.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:39:17.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-19T12:39:17.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-19T12:39:17.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:39:17.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:39:17.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:39:17.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:39:17.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:39:17.476 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:39:17.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9a4d5109-2305-41d7-9ebb-56317741f015 2026-02-19T12:39:17.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9a4d5109-2305-41d7-9ebb-56317741f015' 2026-02-19T12:39:17.476 INFO:tasks.workunit.client.0.trial109.stdout:add osd1 9a4d5109-2305-41d7-9ebb-56317741f015 2026-02-19T12:39:17.477 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:39:17.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB1BJdpBTaTHBAAN5qRn8VZor/cv3AQW6tiQQ== 2026-02-19T12:39:17.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB1BJdpBTaTHBAAN5qRn8VZor/cv3AQW6tiQQ=="}' 2026-02-19T12:39:17.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9a4d5109-2305-41d7-9ebb-56317741f015 -i td/divergent-priors/1/new.json 2026-02-19T12:39:17.710 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:39:17.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T12:39:17.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB1BJdpBTaTHBAAN5qRn8VZor/cv3AQW6tiQQ== --osd-uuid 9a4d5109-2305-41d7-9ebb-56317741f015 2026-02-19T12:39:17.750 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:17.739+0000 7fdaea060a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:17.752 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:17.739+0000 7fdaea060a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:17.753 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:17.743+0000 7fdaea060a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:17.753 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:17.743+0000 7fdaea060a40 -1 bdev(0x5569f51dac00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T12:39:17.754 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:17.743+0000 7fdaea060a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T12:39:18.404 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T12:39:18.404 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:39:18.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T12:39:18.405 INFO:tasks.workunit.client.0.trial109.stdout:adding osd1 key to auth repository 2026-02-19T12:39:18.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:39:18.703 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:39:18.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T12:39:18.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:39:18.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:39:18.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:39:18.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:39:18.733 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:18.723+0000 7f0966928a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:18.734 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:18.723+0000 7f0966928a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:18.735 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:18.723+0000 7f0966928a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:18.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T12:39:18.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:39:18.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:39:18.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:39:18.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:39:18.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:18.923 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:39:18.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:39:18.924 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:18.924 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:39:19.147 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:39:19.198 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:19.187+0000 7f0966928a40 -1 Falling back to public interface 2026-02-19T12:39:19.847 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:19.835+0000 7f0966928a40 -1 osd.1 0 log_to_monitors true 2026-02-19T12:39:20.149 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:39:20.149 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:20.149 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:39:20.150 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:39:20.150 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:20.150 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:39:20.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:39:21.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:39:21.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:21.359 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:39:21.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:39:21.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:21.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:39:21.576 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/374083243,v1:127.0.0.1:6811/374083243] [v2:127.0.0.1:6812/374083243,v1:127.0.0.1:6813/374083243] exists,up 9a4d5109-2305-41d7-9ebb-56317741f015 2026-02-19T12:39:21.579 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:39:21.579 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:39:21.579 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:39:21.579 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:39:21.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:21.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:39:21.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:39:21.583 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:39:21.583 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=557f0114-bbbc-4956-a5dd-df55a9970c21 2026-02-19T12:39:21.583 INFO:tasks.workunit.client.0.trial109.stdout:add osd2 557f0114-bbbc-4956-a5dd-df55a9970c21 2026-02-19T12:39:21.584 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 557f0114-bbbc-4956-a5dd-df55a9970c21' 2026-02-19T12:39:21.584 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:39:21.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB5BJdpzaPiIhAAHY7ivQ7sZFAcFTpoXW3LeA== 2026-02-19T12:39:21.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB5BJdpzaPiIhAAHY7ivQ7sZFAcFTpoXW3LeA=="}' 2026-02-19T12:39:21.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 557f0114-bbbc-4956-a5dd-df55a9970c21 -i td/divergent-priors/2/new.json 2026-02-19T12:39:21.819 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:39:21.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T12:39:21.829 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB5BJdpzaPiIhAAHY7ivQ7sZFAcFTpoXW3LeA== --osd-uuid 557f0114-bbbc-4956-a5dd-df55a9970c21 2026-02-19T12:39:21.850 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:21.838+0000 7fc885a2fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:21.851 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:21.838+0000 7fc885a2fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:21.852 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:21.838+0000 7fc885a2fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:21.853 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:21.838+0000 7fc885a2fa40 -1 bdev(0x556cfb8fac00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T12:39:21.853 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:21.838+0000 7fc885a2fa40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T12:39:22.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T12:39:22.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:39:22.457 INFO:tasks.workunit.client.0.trial109.stdout:adding osd2 key to auth repository 2026-02-19T12:39:22.457 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T12:39:22.457 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:39:22.748 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T12:39:22.748 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:39:22.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:39:22.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:39:22.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:39:22.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:39:22.780 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:22.766+0000 7fbb886dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:22.781 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:22.770+0000 7fbb886dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:22.783 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:22.770+0000 7fbb886dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:22.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T12:39:22.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:39:22.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:39:22.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:39:22.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:39:22.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:22.963 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:39:22.963 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:39:22.963 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:22.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:39:23.146 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:23.134+0000 7fbb886dea40 -1 Falling back to public interface 2026-02-19T12:39:23.180 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:39:23.803 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:23.790+0000 7fbb886dea40 -1 osd.2 0 log_to_monitors true 2026-02-19T12:39:24.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:39:24.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:24.182 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:39:24.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:39:24.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:24.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:39:24.389 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:39:25.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:39:25.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:25.391 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:39:25.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:39:25.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:25.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:39:25.597 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2459906743,v1:127.0.0.1:6819/2459906743] [v2:127.0.0.1:6820/2459906743,v1:127.0.0.1:6821/2459906743] exists,up 557f0114-bbbc-4956-a5dd-df55a9970c21 2026-02-19T12:39:25.598 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:39:25.598 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:39:25.598 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:39:25.598 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-19T12:39:25.904 INFO:tasks.workunit.client.0.trial109.stderr:noout is set 2026-02-19T12:39:25.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-19T12:39:26.208 INFO:tasks.workunit.client.0.trial109.stderr:noin is set 2026-02-19T12:39:26.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-19T12:39:26.513 INFO:tasks.workunit.client.0.trial109.stderr:nodown is set 2026-02-19T12:39:26.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-19T12:39:26.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-19T12:39:26.766 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' already exists 2026-02-19T12:39:26.777 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:39:27.778 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-19T12:39:28.128 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 size to 3 2026-02-19T12:39:28.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-19T12:39:28.433 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 min_size to 2 2026-02-19T12:39:28.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-19T12:39:28.737 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 pg_autoscale_mode to on 2026-02-19T12:39:28.748 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-19T12:39:28.749 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-19T12:39:28.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771504768 2026-02-19T12:39:28.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-19T12:39:28.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-19T12:39:28.751 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-19T12:39:28.751 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:39:28.751 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:39:28.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:39:28.964 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:39:28.964 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:39:28.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:39:28.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:28.965 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:39:29.045 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-19T12:39:29.045 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-19T12:39:29.045 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-19T12:39:29.045 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:29.046 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:39:29.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-19T12:39:29.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-19T12:39:29.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-19T12:39:29.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:29.129 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:39:29.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-19T12:39:29.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-19T12:39:29.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542147' 2026-02-19T12:39:29.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:29.210 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-19T12:39:29.210 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:29.211 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:39:29.212 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-19T12:39:29.212 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:29.213 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-19T12:39:29.213 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-19T12:39:29.214 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836485 2026-02-19T12:39:29.214 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:39:29.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-19T12:39:29.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:29.434 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-19T12:39:29.434 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:29.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:39:29.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-19T12:39:29.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:29.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-19T12:39:29.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-19T12:39:29.438 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705668 2026-02-19T12:39:29.438 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:39:29.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705666 -lt 38654705668 2026-02-19T12:39:29.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:39:30.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:39:30.651 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:39:30.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705666 -lt 38654705668 2026-02-19T12:39:30.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:39:31.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:39:31.872 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:39:32.091 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-19T12:39:32.091 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:32.092 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-19T12:39:32.092 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:32.093 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:39:32.093 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542147 2026-02-19T12:39:32.094 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:32.095 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542147 2026-02-19T12:39:32.095 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-19T12:39:32.095 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 60129542147 2026-02-19T12:39:32.096 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:39:32.321 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-19T12:39:32.321 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-19T12:39:32.321 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:39:32.321 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:39:32.321 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:39:32.322 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:39:32.322 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:39:32.323 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:39:32.323 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:39:32.323 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:39:32.323 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:39:32.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:39:32.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:39:32.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:39:32.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:39:32.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:39:32.425 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:39:32.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:39:32.648 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:39:32.648 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:39:32.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:39:32.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:32.649 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:39:32.731 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-19T12:39:32.731 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-19T12:39:32.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-19T12:39:32.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:32.732 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:39:32.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-19T12:39:32.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-19T12:39:32.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671' 2026-02-19T12:39:32.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:32.812 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:39:32.894 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-19T12:39:32.894 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-19T12:39:32.894 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671 2-60129542150' 2026-02-19T12:39:32.894 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:32.895 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-19T12:39:32.895 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:32.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:39:32.896 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-19T12:39:32.896 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:32.898 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-19T12:39:32.898 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836487 2026-02-19T12:39:32.898 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-19T12:39:32.899 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:39:33.116 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836487 2026-02-19T12:39:33.116 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:33.116 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-19T12:39:33.117 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:33.118 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:39:33.118 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705671 2026-02-19T12:39:33.119 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:33.120 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705671 2026-02-19T12:39:33.120 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705671 2026-02-19T12:39:33.120 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-19T12:39:33.120 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:39:33.345 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-19T12:39:33.345 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:33.346 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-19T12:39:33.346 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:33.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:39:33.348 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542150 2026-02-19T12:39:33.348 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:33.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542150 2026-02-19T12:39:33.349 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 60129542150 2026-02-19T12:39:33.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-19T12:39:33.350 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:39:33.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-19T12:39:33.576 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:39:33.576 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:39:33.576 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:39:33.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:39:33.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:39:33.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:39:33.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:39:33.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:39:33.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:39:33.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:39:33.868 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:39:34.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:39:34.083 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:39:34.084 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:39:34.084 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:39:34.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:39:34.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:39:34.376 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:39:34.376 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-19T12:39:34.376 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-19T12:39:34.580 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:39:34.590 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-19T12:39:34.590 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-19T12:39:34.590 INFO:tasks.workunit.client.0.trial109.stdout:primary and soon to be divergent is 1 2026-02-19T12:39:34.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:39:34.787 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:39:34.787 INFO:tasks.workunit.client.0.trial109.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T12:39:27.765941+0000 0'0 30:26 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:17:40.861888+0000 0 0 2026-02-19T12:39:34.787 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:39:34.787 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:39:34.787 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:39:34.796 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-19T12:39:34.797 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771504774 2026-02-19T12:39:34.797 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771504774 - 1771504768 2026-02-19T12:39:34.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=6 2026-02-19T12:39:34.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 6 -gt 300 ']' 2026-02-19T12:39:34.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-19T12:39:34.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-19T12:39:34.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-19T12:39:34.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stdout:writing initial objects 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-19T12:39:34.800 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-19T12:39:34.801 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.801 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:34.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.824 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:34.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:34.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.880 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:34.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:34.930 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.931 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:34.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:34.985 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:34.985 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.014 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.014 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.092 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.092 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.121 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.121 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.147 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.147 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.315 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.315 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.343 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.343 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.427 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.427 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.455 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.510 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.510 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.584 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.584 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.633 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.633 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.799 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.854 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.854 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.938 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.939 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:35.994 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:35.995 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.023 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.051 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.078 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.180 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.180 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.207 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.207 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.235 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.235 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.264 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.320 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.320 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.395 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.395 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.507 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.507 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.647 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.675 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.675 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.731 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.731 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.759 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.759 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.843 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.843 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.900 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:36.983 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:36.983 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.011 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.011 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.039 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.039 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.124 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.151 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.151 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.178 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.178 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.206 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.207 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.235 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.235 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.312 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.312 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.395 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.395 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T12:39:37.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.omb2QIlYmB 2026-02-19T12:39:37.526 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:39:37.526 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-19T12:39:37.526 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:39:37.526 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:39:37.526 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:39:37.526 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:39:37.527 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:39:37.527 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:39:37.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:39:37.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:39:37.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:39:37.584 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:39:37.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:39:37.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:39:37.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:39:37.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:39:37.585 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:39:37.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:39:37.790 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:39:37.790 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:39:37.790 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:39:37.790 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:37.790 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:39:37.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-19T12:39:37.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-19T12:39:37.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-19T12:39:37.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:37.870 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:39:37.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-19T12:39:37.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-19T12:39:37.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-19T12:39:37.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:37.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:39:38.034 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-19T12:39:38.034 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-19T12:39:38.035 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542153' 2026-02-19T12:39:38.035 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:38.035 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-19T12:39:38.036 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:38.036 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:39:38.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-19T12:39:38.037 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:38.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-19T12:39:38.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-19T12:39:38.039 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836490 2026-02-19T12:39:38.039 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:39:38.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-19T12:39:38.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:39:39.250 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:39:39.250 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:39:39.467 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836490 2026-02-19T12:39:39.467 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:39.468 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-19T12:39:39.468 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:39.469 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:39:39.469 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-19T12:39:39.470 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:39.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-19T12:39:39.471 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705674 2026-02-19T12:39:39.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-19T12:39:39.472 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:39:39.682 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-19T12:39:39.682 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:39.683 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-19T12:39:39.683 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:39.684 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:39:39.685 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542153 2026-02-19T12:39:39.685 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:39.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542153 2026-02-19T12:39:39.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-19T12:39:39.687 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 60129542153 2026-02-19T12:39:39.687 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:39:39.908 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-19T12:39:39.909 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:39:39.910 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:39:39.910 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:39:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:39:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:39:40.193 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:39:40.193 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:39:40.193 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:39:40.193 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:39:40.193 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:39:40.193 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:39:40.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:39:40.410 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:39:40.410 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:39:40.410 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:39:40.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:39:40.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:39:40.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:39:40.699 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-19T12:39:40.699 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T12:39:40.700 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T12:39:40.700 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T12:39:40.700 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T12:39:40.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-19T12:39:40.922 INFO:tasks.workunit.client.0.trial109.stdout:blackholing osds 0 2 2026-02-19T12:39:40.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-19T12:39:40.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:39:41.118 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:39:41.118 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T12:39:27.765941+0000 30'100 30:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:17:40.861888+0000 0 0 2026-02-19T12:39:41.118 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:39:41.118 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:39:41.119 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:39:41.126 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:41.127 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-19T12:39:41.127 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:39:41.127 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:39:41.127 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:39:41.128 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:41.128 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:41.128 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:39:41.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-19T12:39:41.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T12:39:41.181 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:39:41.181 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:39:41.181 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:39:41.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:41.187 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-19T12:39:41.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:39:41.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:39:41.188 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:39:41.188 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:41.188 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:41.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:39:41.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-19T12:39:41.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T12:39:41.239 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:39:41.239 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:39:41.239 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:39:41.245 INFO:tasks.workunit.client.0.trial109.stdout:create new divergent objects 2026-02-19T12:39:41.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-19T12:39:41.245 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-19T12:39:41.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:39:41.246 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:39:41.246 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-19T12:39:41.246 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-19T12:39:41.247 INFO:tasks.workunit.client.0.trial109.stdout:writing divergent objects 2026-02-19T12:39:41.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-19T12:39:41.247 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-19T12:39:41.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T12:39:41.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T12:39:41.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.xJAogCLnU3 2026-02-19T12:39:41.249 INFO:tasks.workunit.client.0.trial109.stdout:remove divergent objects 2026-02-19T12:39:41.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-19T12:39:41.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.xJAogCLnU3 2026-02-19T12:39:41.249 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-19T12:39:41.250 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T12:39:41.250 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-19T12:39:41.251 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-19T12:39:41.252 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T12:39:41.252 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-19T12:39:41.252 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-19T12:39:41.253 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-19T12:39:41.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-19T12:39:41.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-19T12:39:51.255 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-19T12:39:51.308 INFO:tasks.workunit.client.0.trial109.stderr:rados: no process found 2026-02-19T12:39:51.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-19T12:39:51.308 INFO:tasks.workunit.client.0.trial109.stdout:killing all the osds 2026-02-19T12:39:51.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:39:51.522 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:39:51.522 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-19T12:39:27.765941+0000 30'106 30:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:17:40.861888+0000 0 0 2026-02-19T12:39:51.522 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:39:51.522 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:39:51.522 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:39:51.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-19T12:39:51.531 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:39:51.531 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:39:51.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:39:51.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:39:51.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:39:51.641 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:39:51.641 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-19T12:39:51.641 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-19T12:39:51.902 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:39:51.911 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-19T12:39:51.911 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-19T12:39:52.186 INFO:tasks.workunit.client.0.trial109.stderr:osd.1 is already down. 2026-02-19T12:39:52.195 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-19T12:39:52.196 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-19T12:39:52.470 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already down. 2026-02-19T12:39:52.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:52.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-19T12:39:52.753 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already out. 2026-02-19T12:39:52.763 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:52.763 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-19T12:39:53.037 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already out. 2026-02-19T12:39:53.046 INFO:tasks.workunit.client.0.trial109.stdout:bringing up non_divergent 0 2 2026-02-19T12:39:53.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-19T12:39:53.047 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:39:53.255 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:39:53.255 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-19T12:39:27.765941+0000 30'106 30:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:17:40.861888+0000 0 0 2026-02-19T12:39:53.255 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:39:53.255 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:39:53.255 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:39:53.265 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:39:53.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:39:53.267 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:39:53.267 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:39:53.267 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:39:53.267 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:39:53.267 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:53.267 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:53.267 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:39:53.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:39:53.269 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:39:53.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:39:53.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:39:53.269 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T12:39:53.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:39:53.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:39:53.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:39:53.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:39:53.294 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:53.281+0000 7fb516d02a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:53.296 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:53.281+0000 7fb516d02a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:53.297 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:53.281+0000 7fb516d02a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:53.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:39:53.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:39:53.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:39:53.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:39:53.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:39:53.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:53.490 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:39:53.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:39:53.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:53.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:39:53.702 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:39:53.703 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:53.689+0000 7fb516d02a40 -1 Falling back to public interface 2026-02-19T12:39:54.301 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:54.285+0000 7fb516d02a40 -1 osd.0 30 log_to_monitors true 2026-02-19T12:39:54.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:39:54.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:54.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:39:54.704 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:39:54.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:54.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:39:54.922 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [5,30) [v2:127.0.0.1:6802/2201245360,v1:127.0.0.1:6803/2201245360] [v2:127.0.0.1:6804/2201245360,v1:127.0.0.1:6805/2201245360] exists,up 622d3a9f-6590-4503-8abc-1d26518e854d 2026-02-19T12:39:54.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:39:54.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:39:54.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:39:54.927 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:39:54.928 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:39:54.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:39:54.930 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:39:54.930 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:39:54.930 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:39:54.930 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:39:54.931 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:39:54.931 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:39:54.931 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T12:39:54.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:39:54.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:39:54.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:39:54.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:39:54.954 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:54.941+0000 7f5067a1aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:54.955 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:54.941+0000 7f5067a1aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:54.957 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:54.941+0000 7f5067a1aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:39:55.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:39:55.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:39:55.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:39:55.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:39:55.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:39:55.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:55.141 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:39:55.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:39:55.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:55.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:39:55.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:39:55.423 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:55.409+0000 7f5067a1aa40 -1 Falling back to public interface 2026-02-19T12:39:56.013 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:39:55.997+0000 7f5067a1aa40 -1 osd.2 30 log_to_monitors true 2026-02-19T12:39:56.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:39:56.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:39:56.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:39:56.352 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:39:56.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:39:56.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:39:56.563 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up out weight 0 up_from 40 up_thru 0 down_at 33 last_clean_interval [14,30) [v2:127.0.0.1:6810/473666236,v1:127.0.0.1:6811/473666236] [v2:127.0.0.1:6812/473666236,v1:127.0.0.1:6813/473666236] exists,up 557f0114-bbbc-4956-a5dd-df55a9970c21 2026-02-19T12:39:56.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:39:56.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:39:56.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:39:56.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:56.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-19T12:39:56.823 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already in. 2026-02-19T12:39:56.832 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:39:56.832 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-19T12:39:57.105 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already in. 2026-02-19T12:39:57.115 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:39:57.115 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-19T12:39:57.115 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:39:57.115 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:39:57.115 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:39:57.115 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:39:57.116 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:39:57.116 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:39:57.117 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:39:57.117 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:39:57.117 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:39:57.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:39:57.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:39:57.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:39:57.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:39:57.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:39:57.183 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:39:57.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:39:57.399 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:39:57.399 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:39:57.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:39:57.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:57.399 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:39:57.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-19T12:39:57.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-19T12:39:57.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-158913789955' 2026-02-19T12:39:57.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:57.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:39:57.542 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:39:57.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:39:57.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:39:57.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:39:57.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:39:57.544 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:39:57.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691843 2026-02-19T12:39:57.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691843 2026-02-19T12:39:57.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-158913789955 2-171798691843' 2026-02-19T12:39:57.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:39:57.629 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-158913789955 2026-02-19T12:39:57.629 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:39:57.629 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:39:57.630 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-158913789955 2026-02-19T12:39:57.630 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:39:57.632 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789955 2026-02-19T12:39:57.632 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 158913789955' 2026-02-19T12:39:57.632 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 158913789955 2026-02-19T12:39:57.632 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:39:57.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 158913789955 2026-02-19T12:39:57.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:39:58.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:39:58.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:39:59.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 158913789955 2026-02-19T12:39:59.074 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:40:00.074 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:40:00.074 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:40:00.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-19T12:40:00.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:40:00.298 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-171798691843 2026-02-19T12:40:00.299 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:40:00.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:40:00.301 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-171798691843 2026-02-19T12:40:00.301 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:40:00.302 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691843 2026-02-19T12:40:00.302 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 171798691843' 2026-02-19T12:40:00.302 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 171798691843 2026-02-19T12:40:00.302 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:40:00.519 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691843 -lt 171798691843 2026-02-19T12:40:00.520 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:40:00.520 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:00.520 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:00.809 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:40:00.810 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:00.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:00.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:00.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:00.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:00.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:00.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:01.024 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:01.024 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:01.025 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:01.025 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:01.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:40:01.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T12:40:01.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T12:40:01.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T12:40:01.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:01.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T12:40:01.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:01.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:01.410 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:01.410 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:01.411 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:01.411 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:01.411 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:01.411 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:01.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:01.616 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:01.616 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:01.616 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:01.901 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:01.902 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:02.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:02.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:02.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T12:40:02.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:02.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T12:40:02.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:02.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:02.383 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:02.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:02.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:02.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:02.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:02.384 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:02.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:02.594 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:02.594 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:02.594 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:02.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:02.872 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:03.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:03.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:03.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T12:40:03.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:03.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T12:40:03.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:03.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:03.564 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:03.564 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:03.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:03.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:03.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:03.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:03.778 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:03.779 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:03.779 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:03.779 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:04.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:40:04.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:04.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:04.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:04.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:04.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:04.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:04.073 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:04.073 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:04.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:04.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:04.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T12:40:04.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:04.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T12:40:05.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:05.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:05.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:05.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:05.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:05.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:05.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:05.165 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:05.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:05.376 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:05.376 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:05.376 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:05.663 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:05.664 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:05.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:05.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:05.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T12:40:05.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:05.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T12:40:07.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:07.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:07.553 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:07.553 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:07.553 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:07.553 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:07.554 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:07.554 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:07.764 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:07.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:07.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:07.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:08.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:08.318 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:08.318 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:08.318 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T12:40:08.318 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:08.318 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T12:40:11.519 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:11.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:11.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:11.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:11.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:11.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:11.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:11.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:11.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:11.733 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:11.733 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:11.733 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:12.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:40:12.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:12.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:12.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:12.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:12.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:12.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:12.009 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:12.009 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:12.278 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:12.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:12.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T12:40:12.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:12.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T12:40:18.680 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:18.681 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:18.682 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:18.682 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:18.682 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:18.682 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:18.682 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:18.682 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:18.889 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:18.890 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:18.890 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:18.890 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:19.166 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:19.166 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:19.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:19.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:19.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:19.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:19.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:19.167 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:19.167 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:19.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:19.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:19.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T12:40:19.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:19.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T12:40:26.740 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:26.740 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:26.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:26.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:26.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:26.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:26.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:26.741 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:26.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:26.956 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:26.956 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:26.956 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:27.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:27.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:27.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:27.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:27.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:27.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:27.242 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:27.243 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:27.243 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:27.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:27.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:27.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T12:40:27.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_fingerprint": "fdb266c9-4bbf-4a83-8849-a1ba679a01c9", 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "version": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "commit": "2fc421c83f0b86ea21b9e4289cad0f7957e09eb1", 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "timestamp": "2026-02-19T12:40:27.786857+0000", 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "tag": "", 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "health": { 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "status": "HEALTH_WARN", 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "checks": { 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "OSDMAP_FLAGS": { 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:40:27.796 INFO:tasks.workunit.client.0.trial109.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "count": 17 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [], 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "OSD_DOWN": { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "1 osds down", 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "osd.1 (root=default,host=trial109) is down" 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "PG_DEGRADED": { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "count": 32 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.797 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.798 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "mutes": [] 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_first_committed": 1, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_last_committed": 1, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "monmap": { 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:40:27.799 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:39:14.259745Z", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:39:14.259745Z", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release": 20, 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release_name": "tentacle", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "election_strategy": 1, 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "disallowed_leaders": "", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": false, 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "tiebreaker_mon": "", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "removed_ranks": "", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "features": { 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "persistent": [ 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "kraken", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "luminous", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "mimic", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap-prune", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "nautilus", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "octopus", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "pacific", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "elector-pinging", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "quincy", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "reef", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "squid", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "tentacle", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "nvmeof_beacon_diff" 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "optional": [] 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "mons": [ 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "rank": 0, 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "name": "a", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 0 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "priority": 0, 2026-02-19T12:40:27.800 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 0, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "crush_location": "{}" 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "quorum": [ 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: 0 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap": { 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 46, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:39:14.338111+0000", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:40:17.199009+0000", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "last_up_change": "2026-02-19T12:39:56.159731+0000", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "last_in_change": "2026-02-19T12:39:57.041354+0000", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "flags_num": 5800384, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "flags_set": [ 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "nodown", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "noin", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "noout", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "pglog_hardlimit", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snapdirs", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "recovery_deletes", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "sortbitwise" 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "crush_version": 9, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_snapshot": "", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "pool_max": 1, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "max_osd": 3, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "require_min_compat_client": "luminous", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "min_compat_client": "jewel", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "require_osd_release": "tentacle", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "allow_crimson": false, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "pools": [ 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "pool_name": "test", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "create_time": "2026-02-19T12:39:26.679203+0000", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "flags": 1, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "flags_names": "hashpspool", 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:40:27.801 INFO:tasks.workunit.client.0.trial109.stdout: "size": 3, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "min_size": 2, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "crush_rule": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_count": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_target": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "is_stretch_pool": false, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "object_hash": 2, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "pg_autoscale_mode": "on", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num": 32, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num": 1, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num_target": 32, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_target": 32, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_pending": 32, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "last_pg_merge_meta": { 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "source_pgid": "0.0", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "ready_epoch": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_started": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "source_version": "0'0", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "target_version": "0'0" 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "last_change": "45", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend": "0", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_preluminous": "45", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "auid": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "snap_mode": "selfmanaged", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "snap_seq": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "snap_epoch": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "pool_snaps": [], 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps": "[]", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_bytes": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_objects": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "tiers": [], 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "tier_of": -1, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "read_tier": -1, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "write_tier": -1, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "cache_mode": "none", 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_bytes": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_objects": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_flush_age": 0, 2026-02-19T12:40:27.802 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_evict_age": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profile": "", 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_params": { 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "type": "none" 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_period": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_count": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "use_gmt_hitset": true, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "min_read_recency_for_promote": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "min_write_recency_for_promote": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_search_last_n": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "grade_table": [], 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "stripe_width": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "expected_num_objects": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "fast_read": false, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "nonprimary_shards": "{}", 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "options": {}, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "application_metadata": {}, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "read_balance": { 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "score_type": "Fair distribution", 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "score_acting": 2.9900000095367432, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "score_stable": 2.9900000095367432, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_acting": 2, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_stable": 2, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity_weighted": 1, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity": 1, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity_weighted": 1 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "osds": [ 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "622d3a9f-6590-4503-8abc-1d26518e854d", 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 5, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 30, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 37, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 45, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 31, 2026-02-19T12:40:27.803 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6802", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6803", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6804", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6805", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6808", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6809", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.804 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6806", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6807", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6803/2201245360", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6805/2201245360", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2201245360", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2201245360", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "9a4d5109-2305-41d7-9ebb-56317741f015", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "up": 0, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 0, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 0, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 9, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 22, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 32, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.805 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/374083243", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/374083243", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/374083243", 2026-02-19T12:40:27.806 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/374083243", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "exists" 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "557f0114-bbbc-4956-a5dd-df55a9970c21", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 14, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 30, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 40, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 0, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 33, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.807 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/473666236", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/473666236", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/473666236", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/473666236", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "osd_xinfo": [ 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:39:51.837068+0000", 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:40:27.808 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:39:17.817362+0000", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:39:52.121867+0000", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:39:20.810637+0000", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:39:52.405850+0000", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:39:24.749540+0000", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap": [], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_items": [], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_primaries": [], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "pg_temp": [], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "primary_temp": [], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "blocklist": {}, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "range_blocklist": {}, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profiles": { 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "default": { 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "m": "2", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps_queue": [], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "new_removed_snaps": [], 2026-02-19T12:40:27.809 INFO:tasks.workunit.client.0.trial109.stdout: "new_purged_snaps": [], 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "crush_node_flags": {}, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "device_class_flags": {}, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": { 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_enabled": false, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_bucket_count": 0, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "degraded_stretch_mode": 0, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "recovering_stretch_mode": 0, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_bucket": 0 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "osd_metadata": [ 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6804/2201245360,v1:127.0.0.1:6805/2201245360]", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:39:15.417100Z", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:40:27.810 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6802/2201245360,v1:127.0.0.1:6803/2201245360]", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2201245360,v1:127.0.0.1:6809/2201245360]", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2201245360,v1:127.0.0.1:6807/2201245360]", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/374083243,v1:127.0.0.1:6813/374083243]", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:40:27.811 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:39:18.287673Z", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/374083243,v1:127.0.0.1:6811/374083243]", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/374083243,v1:127.0.0.1:6817/374083243]", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/374083243,v1:127.0.0.1:6815/374083243]", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/473666236,v1:127.0.0.1:6813/473666236]", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:40:27.812 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:39:22.355608Z", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/473666236,v1:127.0.0.1:6811/473666236]", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/473666236,v1:127.0.0.1:6817/473666236]", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/473666236,v1:127.0.0.1:6815/473666236]", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:40:27.813 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_clean_epochs": { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "min_last_epoch_clean": 0, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "per_pool": [] 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "osd_epochs": [ 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 37 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 41 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_first_committed": 1, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_last_committed": 46, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "crushmap": { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "devices": [ 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.0", 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.1", 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.2", 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "types": [ 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 0, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd" 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:40:27.814 INFO:tasks.workunit.client.0.trial109.stdout: "name": "host" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 2, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "chassis" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 3, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "rack" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 4, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "row" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 5, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pdu" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 6, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pod" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 7, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "room" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 8, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "datacenter" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 9, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "zone" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 10, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: "name": "region" 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.815 INFO:tasks.workunit.client.0.trial109.stderr:report 3991439445 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "name": "root" 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "buckets": [ 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "id": -1, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "id": -2, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default~ssd", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.816 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109~ssd", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.817 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "rules": [ 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 0, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "replicated_rule", 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_firstn", 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "tunables": { 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_tries": 0, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_fallback_tries": 0, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "choose_total_tries": 50, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_descend_once": 1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_vary_r": 1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_stable": 1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "msr_descents": 100, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "msr_collision_tries": 100, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "straw_calc_version": 1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "allowed_bucket_algs": 54, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "profile": "jewel", 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_tunables": 1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "legacy_tunables": 0, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "minimum_required_version": "jewel", 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables": 1, 2026-02-19T12:40:27.818 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables2": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "has_v2_rules": 0, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables3": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "has_v3_rules": 0, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "has_v4_buckets": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables5": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "has_v5_rules": 0, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "has_msr_rules": 0 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "choose_args": {} 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "fsmap": { 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "btime": "2026-02-19T12:39:14:337911+0000", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "default_fscid": -1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "compat": { 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "compat": {}, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "ro_compat": {}, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "incompat": { 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_1": "base v0.20", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_2": "client writeable ranges", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_4": "dir inode in separate object", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_8": "no anchor table", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_9": "file layout v2", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_10": "snaprealm v2", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_11": "minor log segments", 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "feature_flags": { 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "enable_multiple": true, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "ever_enabled_multiple": true 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "standbys": [], 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "filesystems": [] 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_first_committed": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_last_committed": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "auth": { 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 5, 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: "num_secrets": 3 2026-02-19T12:40:27.819 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 32, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_active": 32, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_unknown": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_osd": 3, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "pool_sum": { 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51200, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 100, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 100, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:40:27.820 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 512, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 512, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "up": 64, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 64, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 0 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum": { 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 65, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83976, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2192, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 28, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81699, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488824, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036555776, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2244608, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 464656, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 29315, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83660157 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:40:27.821 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum_by_class": { 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "ssd": { 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 65, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83976, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2192, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 28, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81699, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488824, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036555776, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2244608, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 464656, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 29315, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83660157 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:40:27.822 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "pool_stats": [ 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 32, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51200, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 100, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 100, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:40:27.823 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 1220608, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 153552, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 512, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 512, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "up": 64, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 64, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 3 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "osd_stats": [ 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 158913789961 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 38654705677 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:27.824 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 171798691849 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_state": [ 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded+wait", 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num": 1 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded", 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num": 31 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "pool_pg_unavailable_map": [ 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": "1", 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "pgs": [] 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_osd": [ 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 32, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 32, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 32, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 0, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": [ 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": {} 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "servicemap": { 2026-02-19T12:40:27.825 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 3, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:40:21.047102+0000", 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "services": { 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "osd": { 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "daemons": { 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "summary": "", 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "0": { 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "2": { 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_first_committed": 1, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_last_committed": 37, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "logm_first_committed": 1, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "logm_last_committed": 231, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "paxos": { 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 324, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "last_pn": 0, 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: "accepted_pn": 0 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:27.826 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:40:27.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T12:40:27.827 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-19T12:40:27.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-19T12:40:27.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-19T12:40:27.827 INFO:tasks.workunit.client.0.trial109.stdout:writing non-divergent object existing_4 2026-02-19T12:40:27.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:40:28.010 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212138+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212097+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211161+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213394+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211509+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211228+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210413+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213510+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213588+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213782+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213447+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213357+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210946+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213532+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210842+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211575+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-19T12:40:17.206328+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213369+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213546+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213486+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.011 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210112+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213641+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213316+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211090+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211553+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210988+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211516+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211112+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211719+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213105+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213523+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210815+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:40:28.012 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:40:28.021 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.xJAogCLnU3 2026-02-19T12:40:28.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:40:28.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-19T12:40:28.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:40:28.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:40:28.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:40:28.043 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:40:28.043 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:40:28.043 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:40:28.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:40:28.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:40:28.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:40:28.114 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:40:28.114 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:40:28.114 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:40:28.114 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:40:28.114 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:40:28.115 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:40:28.333 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:40:28.333 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:40:28.333 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:40:28.333 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:40:28.333 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:40:28.334 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:40:28.418 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-19T12:40:28.418 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-19T12:40:28.419 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-158913789963' 2026-02-19T12:40:28.419 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:40:28.419 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:40:28.479 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:40:28.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:40:28.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:40:28.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:40:28.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:40:28.482 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:40:28.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691851 2026-02-19T12:40:28.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691851 2026-02-19T12:40:28.561 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-158913789963 2-171798691851' 2026-02-19T12:40:28.561 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:40:28.561 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-158913789963 2026-02-19T12:40:28.561 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:40:28.562 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:40:28.562 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-158913789963 2026-02-19T12:40:28.563 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:40:28.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789963 2026-02-19T12:40:28.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 158913789963' 2026-02-19T12:40:28.565 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 158913789963 2026-02-19T12:40:28.565 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:40:28.775 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789961 -lt 158913789963 2026-02-19T12:40:28.775 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:40:29.776 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:40:29.776 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:40:29.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-19T12:40:29.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:40:29.992 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-171798691851 2026-02-19T12:40:29.992 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:40:29.993 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:40:29.994 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-171798691851 2026-02-19T12:40:29.994 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:40:29.995 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=171798691851 2026-02-19T12:40:29.995 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 171798691851 2026-02-19T12:40:29.996 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 171798691851' 2026-02-19T12:40:29.996 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:40:30.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 171798691851 -lt 171798691851 2026-02-19T12:40:30.226 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:40:30.226 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:30.226 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:30.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-19T12:40:30.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:30.513 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:30.513 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:30.513 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:30.513 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:30.514 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:30.514 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:30.724 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:30.725 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:30.725 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:30.725 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:31.002 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:31.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T12:40:31.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T12:40:31.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T12:40:31.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:31.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T12:40:31.104 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:31.104 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:31.104 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:31.104 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:31.105 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:31.105 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:31.105 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:31.105 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:31.320 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:31.321 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:31.321 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:31.321 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:31.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:31.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:31.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:31.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:31.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:31.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:31.600 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:31.600 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:31.600 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:31.875 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:31.875 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:31.875 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T12:40:31.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:31.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T12:40:32.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:32.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:32.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:32.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:32.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:32.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:32.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:32.077 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:32.294 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:32.295 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:32.295 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:32.295 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:32.577 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:32.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:32.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:32.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:32.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:32.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:32.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:32.579 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:32.579 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:32.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:32.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:32.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T12:40:32.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:32.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T12:40:33.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:33.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:33.271 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:33.271 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:33.272 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:33.272 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:33.272 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:33.272 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:33.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:33.484 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:33.484 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:33.485 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:33.775 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:33.775 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:33.775 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:33.776 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:33.776 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:33.776 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:33.776 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:33.776 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:33.776 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:34.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:34.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:34.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T12:40:34.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:34.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T12:40:34.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:34.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:34.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:34.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:34.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:34.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:34.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:34.872 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:35.085 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:35.086 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:35.086 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:35.086 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:35.370 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:35.370 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:35.370 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:35.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:35.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:35.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:35.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:35.371 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:35.371 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:35.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:35.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:35.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T12:40:35.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:35.647 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T12:40:37.246 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:37.247 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:37.248 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:37.248 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:37.248 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:37.248 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:37.248 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:37.248 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:37.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:37.460 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:37.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:37.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:37.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:37.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:37.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:37.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:37.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:37.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:37.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:37.737 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:37.737 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:38.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:38.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:38.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T12:40:38.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:38.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T12:40:41.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:41.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:41.220 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:41.220 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:41.220 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:41.220 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:41.220 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:41.221 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:41.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:41.434 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:41.434 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:41.435 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:41.715 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:42.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:42.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:42.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T12:40:42.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:42.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T12:40:48.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:48.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:48.403 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:48.403 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:48.403 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:48.403 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:48.404 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:48.404 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:48.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:48.621 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:48.621 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:48.621 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:48.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:48.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:48.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:48.902 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:48.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:48.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:48.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:48.903 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:48.903 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:49.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:49.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:49.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T12:40:49.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:40:49.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T12:40:56.487 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:40:56.487 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:40:56.488 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:40:56.489 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:40:56.489 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:40:56.489 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:40:56.489 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:40:56.489 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:40:56.702 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:40:56.703 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:40:56.704 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:40:56.704 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:40:56.986 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:40:56.987 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:40:57.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:40:57.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:40:57.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T12:40:57.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_fingerprint": "fdb266c9-4bbf-4a83-8849-a1ba679a01c9", 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "version": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "commit": "2fc421c83f0b86ea21b9e4289cad0f7957e09eb1", 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "timestamp": "2026-02-19T12:40:57.538037+0000", 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "tag": "", 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "health": { 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "status": "HEALTH_WARN", 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "checks": { 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "OSDMAP_FLAGS": { 2026-02-19T12:40:57.543 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "count": 17 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [], 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "OSD_DOWN": { 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "message": "1 osds down", 2026-02-19T12:40:57.544 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: "message": "osd.1 (root=default,host=trial109) is down" 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: "PG_DEGRADED": { 2026-02-19T12:40:57.545 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:40:57.546 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:40:57.546 INFO:tasks.workunit.client.0.trial109.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-19T12:40:57.546 INFO:tasks.workunit.client.0.trial109.stdout: "count": 32 2026-02-19T12:40:57.546 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.546 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:40:57.546 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.547 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.548 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.549 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.550 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.551 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.552 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.553 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.553 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.553 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.553 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.553 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.553 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.554 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.554 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.554 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.554 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.554 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.554 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.554 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.555 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.556 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.556 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.556 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.556 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.556 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.556 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: "mutes": [] 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_first_committed": 1, 2026-02-19T12:40:57.557 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_last_committed": 1, 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "monmap": { 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:39:14.259745Z", 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:39:14.259745Z", 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release": 20, 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release_name": "tentacle", 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "election_strategy": 1, 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "disallowed_leaders": "", 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": false, 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "tiebreaker_mon": "", 2026-02-19T12:40:57.558 INFO:tasks.workunit.client.0.trial109.stdout: "removed_ranks": "", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "features": { 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "persistent": [ 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "kraken", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "luminous", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "mimic", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap-prune", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "nautilus", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "octopus", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "pacific", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "elector-pinging", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "quincy", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "reef", 2026-02-19T12:40:57.559 INFO:tasks.workunit.client.0.trial109.stdout: "squid", 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "tentacle", 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "nvmeof_beacon_diff" 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "optional": [] 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "mons": [ 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "rank": 0, 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "name": "a", 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.560 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115", 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 0 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "priority": 0, 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 0, 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: "crush_location": "{}" 2026-02-19T12:40:57.561 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "quorum": [ 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: 0 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap": { 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 46, 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:39:14.338111+0000", 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:40:17.199009+0000", 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "last_up_change": "2026-02-19T12:39:56.159731+0000", 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "last_in_change": "2026-02-19T12:39:57.041354+0000", 2026-02-19T12:40:57.562 INFO:tasks.workunit.client.0.trial109.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "flags_num": 5800384, 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "flags_set": [ 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "nodown", 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "noin", 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "noout", 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "pglog_hardlimit", 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snapdirs", 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "recovery_deletes", 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "sortbitwise" 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "crush_version": 9, 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T12:40:57.563 INFO:tasks.workunit.client.0.trial109.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_snapshot": "", 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "pool_max": 1, 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "max_osd": 3, 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "require_min_compat_client": "luminous", 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "min_compat_client": "jewel", 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "require_osd_release": "tentacle", 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "allow_crimson": false, 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: "pools": [ 2026-02-19T12:40:57.564 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "pool_name": "test", 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "create_time": "2026-02-19T12:39:26.679203+0000", 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "flags": 1, 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "flags_names": "hashpspool", 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "size": 3, 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "min_size": 2, 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "crush_rule": 0, 2026-02-19T12:40:57.565 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_count": 0, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_target": 0, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "is_stretch_pool": false, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "object_hash": 2, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "pg_autoscale_mode": "on", 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num": 32, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num": 1, 2026-02-19T12:40:57.566 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num_target": 32, 2026-02-19T12:40:57.567 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_target": 32, 2026-02-19T12:40:57.567 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_pending": 32, 2026-02-19T12:40:57.567 INFO:tasks.workunit.client.0.trial109.stdout: "last_pg_merge_meta": { 2026-02-19T12:40:57.567 INFO:tasks.workunit.client.0.trial109.stdout: "source_pgid": "0.0", 2026-02-19T12:40:57.567 INFO:tasks.workunit.client.0.trial109.stdout: "ready_epoch": 0, 2026-02-19T12:40:57.567 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_started": 0, 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": 0, 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "source_version": "0'0", 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "target_version": "0'0" 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "last_change": "45", 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend": "0", 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_preluminous": "45", 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "auid": 0, 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "snap_mode": "selfmanaged", 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "snap_seq": 0, 2026-02-19T12:40:57.568 INFO:tasks.workunit.client.0.trial109.stdout: "snap_epoch": 0, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "pool_snaps": [], 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps": "[]", 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_bytes": 0, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_objects": 0, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "tiers": [], 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "tier_of": -1, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "read_tier": -1, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "write_tier": -1, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "cache_mode": "none", 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_bytes": 0, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_objects": 0, 2026-02-19T12:40:57.569 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_flush_age": 0, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_evict_age": 0, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profile": "", 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_params": { 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "type": "none" 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_period": 0, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_count": 0, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "use_gmt_hitset": true, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "min_read_recency_for_promote": 0, 2026-02-19T12:40:57.570 INFO:tasks.workunit.client.0.trial109.stdout: "min_write_recency_for_promote": 0, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_search_last_n": 0, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "grade_table": [], 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "stripe_width": 0, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "expected_num_objects": 0, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "fast_read": false, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "nonprimary_shards": "{}", 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "options": {}, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "application_metadata": {}, 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "read_balance": { 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "score_type": "Fair distribution", 2026-02-19T12:40:57.571 INFO:tasks.workunit.client.0.trial109.stdout: "score_acting": 2.9900000095367432, 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "score_stable": 2.9900000095367432, 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_acting": 2, 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "raw_score_stable": 2, 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity_weighted": 1, 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity": 1, 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "average_primary_affinity_weighted": 1 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: "osds": [ 2026-02-19T12:40:57.572 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "622d3a9f-6590-4503-8abc-1d26518e854d", 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 5, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 30, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 37, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 45, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 31, 2026-02-19T12:40:57.573 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6802", 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6803", 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.574 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6804", 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6805", 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.575 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6808", 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6809", 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.576 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6806", 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6807", 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 2201245360 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.577 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6803/2201245360", 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6805/2201245360", 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2201245360", 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2201245360", 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "9a4d5109-2305-41d7-9ebb-56317741f015", 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "up": 0, 2026-02-19T12:40:57.578 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 0, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 0, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 9, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 22, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 32, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.579 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.580 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:40:57.581 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 374083243 2026-02-19T12:40:57.582 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/374083243", 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/374083243", 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/374083243", 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/374083243", 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "exists" 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "557f0114-bbbc-4956-a5dd-df55a9970c21", 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:40:57.583 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 14, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 30, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 40, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 0, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 33, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:40:57.584 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.585 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:40:57.586 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 473666236 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.587 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/473666236", 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/473666236", 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/473666236", 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/473666236", 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "osd_xinfo": [ 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:39:51.837068+0000", 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:40:57.588 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:39:17.817362+0000", 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:39:52.121867+0000", 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:39:20.810637+0000", 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:39:52.405850+0000", 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:40:57.589 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:39:24.749540+0000", 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap": [], 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_items": [], 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_primaries": [], 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "pg_temp": [], 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "primary_temp": [], 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "blocklist": {}, 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "range_blocklist": {}, 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profiles": { 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "default": { 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "m": "2", 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:40:57.590 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps_queue": [], 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "new_removed_snaps": [], 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "new_purged_snaps": [], 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "crush_node_flags": {}, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "device_class_flags": {}, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": { 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_enabled": false, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_bucket_count": 0, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "degraded_stretch_mode": 0, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "recovering_stretch_mode": 0, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_bucket": 0 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "osd_metadata": [ 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:40:57.591 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6804/2201245360,v1:127.0.0.1:6805/2201245360]", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:40:57.592 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:39:15.417100Z", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6802/2201245360,v1:127.0.0.1:6803/2201245360]", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2201245360,v1:127.0.0.1:6809/2201245360]", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2201245360,v1:127.0.0.1:6807/2201245360]", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:40:57.593 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/374083243,v1:127.0.0.1:6813/374083243]", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:40:57.594 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:39:18.287673Z", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:40:57.595 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/374083243,v1:127.0.0.1:6811/374083243]", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/374083243,v1:127.0.0.1:6817/374083243]", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/374083243,v1:127.0.0.1:6815/374083243]", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:40:57.596 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/473666236,v1:127.0.0.1:6813/473666236]", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:40:57.597 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:39:22.355608Z", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/473666236,v1:127.0.0.1:6811/473666236]", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/473666236,v1:127.0.0.1:6817/473666236]", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/473666236,v1:127.0.0.1:6815/473666236]", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:40:57.598 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_clean_epochs": { 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "min_last_epoch_clean": 0, 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": { 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "per_pool": [] 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "osd_epochs": [ 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 37 2026-02-19T12:40:57.599 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 41 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_first_committed": 1, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_last_committed": 46, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "crushmap": { 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "devices": [ 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.0", 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.1", 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.600 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.2", 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "types": [ 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 0, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd" 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "name": "host" 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 2, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "name": "chassis" 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 3, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: "name": "rack" 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.601 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 4, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "name": "row" 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 5, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pdu" 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 6, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pod" 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 7, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "name": "room" 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 8, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "name": "datacenter" 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 9, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "name": "zone" 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.602 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 10, 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: "name": "region" 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stderr:report 2617735443 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: "name": "root" 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: "buckets": [ 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: "id": -1, 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default", 2026-02-19T12:40:57.603 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "id": -2, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default~ssd", 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:57.604 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109", 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.605 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109~ssd", 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.606 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "rules": [ 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 0, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "replicated_rule", 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_firstn", 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "tunables": { 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_tries": 0, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_fallback_tries": 0, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "choose_total_tries": 50, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_descend_once": 1, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_vary_r": 1, 2026-02-19T12:40:57.607 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_stable": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "msr_descents": 100, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "msr_collision_tries": 100, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "straw_calc_version": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "allowed_bucket_algs": 54, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "profile": "jewel", 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_tunables": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "legacy_tunables": 0, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "minimum_required_version": "jewel", 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables2": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "has_v2_rules": 0, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables3": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "has_v3_rules": 0, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "has_v4_buckets": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables5": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "has_v5_rules": 0, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "has_msr_rules": 0 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "choose_args": {} 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "fsmap": { 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "btime": "2026-02-19T12:39:14:337911+0000", 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "default_fscid": -1, 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "compat": { 2026-02-19T12:40:57.608 INFO:tasks.workunit.client.0.trial109.stdout: "compat": {}, 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "ro_compat": {}, 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "incompat": { 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_1": "base v0.20", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_2": "client writeable ranges", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_4": "dir inode in separate object", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_8": "no anchor table", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_9": "file layout v2", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_10": "snaprealm v2", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_11": "minor log segments", 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.609 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "feature_flags": { 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "enable_multiple": true, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "ever_enabled_multiple": true 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "standbys": [], 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "filesystems": [] 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_first_committed": 1, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_last_committed": 1, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "auth": { 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 5, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_secrets": 3 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 32, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_active": 32, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_unknown": 0, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_osd": 3, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "pool_sum": { 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51688, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:40:57.610 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:40:57.611 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 513, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 513, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "up": 64, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 64, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 0 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum": { 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 65, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83976, 2026-02-19T12:40:57.612 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2192, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 28, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81699, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488824, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036555776, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2244608, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 465632, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 29315, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83660157 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:40:57.613 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum_by_class": { 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "ssd": { 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 65, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83976, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2192, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 28, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81699, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488824, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036555776, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2244608, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 465632, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 29315, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83660157 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:40:57.614 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "pool_stats": [ 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 32, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 51688, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 100, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 300, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 100, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 100, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:40:57.615 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 1220608, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 154528, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.616 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 513, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 513, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "up": 64, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 64, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 3 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "osd_stats": [ 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 158913789969 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 38654705677 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 171798691857 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_state": [ 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded", 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "num": 32 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "pool_pg_unavailable_map": [ 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": "1", 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "pgs": [] 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_osd": [ 2026-02-19T12:40:57.617 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 32, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 32, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 32, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 0, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": [ 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": {} 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "servicemap": { 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 5, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:40:57.053375+0000", 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "services": {} 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_first_committed": 1, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_last_committed": 52, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "logm_first_committed": 1, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "logm_last_committed": 289, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "paxos": { 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 397, 2026-02-19T12:40:57.618 INFO:tasks.workunit.client.0.trial109.stdout: "last_pn": 0, 2026-02-19T12:40:57.619 INFO:tasks.workunit.client.0.trial109.stdout: "accepted_pn": 0 2026-02-19T12:40:57.619 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:40:57.619 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:40:57.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T12:40:57.619 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery 2026-02-19T12:40:57.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-19T12:40:57.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212138+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212097+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211161+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213394+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211509+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211228+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210413+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213510+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213588+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213782+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.760 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213447+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213357+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210946+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213532+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210842+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211575+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:30.070753+0000 30'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:18.438252+0000 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213369+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:40:17.213546+0000 46'101 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213486+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210112+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213641+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213316+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211090+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211553+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210988+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211516+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211112+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211719+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213105+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213523+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210815+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:40:57.761 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:40:57.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:40:57.770 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-19T12:40:57.770 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:40:57.770 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:40:57.770 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:40:57.771 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:40:57.771 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:40:57.771 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:40:57.771 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-19T12:40:57.771 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T12:40:57.826 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:40:57.832 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-19T12:40:57.833 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-19T12:40:57.833 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:40:57.833 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:40:57.833 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:40:57.833 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:40:57.833 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:40:57.834 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:40:57.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-19T12:40:57.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T12:40:57.888 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:40:57.894 INFO:tasks.workunit.client.0.trial109.stdout:revive divergent 1 2026-02-19T12:40:57.894 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-19T12:40:57.894 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:40:58.103 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:40:58.103 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212138+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.103 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212097+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.103 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211161+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.103 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213394+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211509+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211228+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210413+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213510+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213588+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213782+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213447+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213357+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210946+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213532+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.104 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210842+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211575+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:30.070753+0000 30'100 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:18.438252+0000 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213369+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:40:17.213546+0000 46'101 46:147 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213486+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210112+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213641+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213316+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211090+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211553+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.105 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210988+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211516+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211112+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211719+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213105+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213523+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210815+0000 30'100 46:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:40:58.106 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:40:58.112 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-19T12:40:58.435 INFO:tasks.workunit.client.0.trial109.stderr:noup is set 2026-02-19T12:40:58.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-19T12:40:58.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:40:58.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:40:58.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:40:58.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:40:58.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:40:58.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:40:58.452 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:40:58.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:40:58.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:40:58.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:40:58.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:40:58.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:40:58.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:40:58.454 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:40:58.455 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:40:58.455 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:40:58.455 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:40:58.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:40:58.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:40:58.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:40:58.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:40:58.477 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:40:58.468+0000 7f810ce13a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:40:58.478 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:40:58.472+0000 7f810ce13a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:40:58.479 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:40:58.472+0000 7f810ce13a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:40:58.670 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T12:40:58.671 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-19T12:40:58.827 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:40:58.820+0000 7f810ce13a40 -1 Falling back to public interface 2026-02-19T12:40:59.455 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:40:59.448+0000 7f810ce13a40 -1 osd.1 30 log_to_monitors true 2026-02-19T12:41:03.671 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery divergent 2026-02-19T12:41:03.672 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-19T12:41:03.672 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:41:03.872 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:03.872 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212138+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.872 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.212097+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211161+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213394+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211509+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211228+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:51.742249+0000 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210413+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:35.588055+0000 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213510+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213588+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213782+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213447+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.873 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213357+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210946+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:48.703281+0000 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213532+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210842+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:40.686424+0000 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211575+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:30.070753+0000 30'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:18.438252+0000 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213369+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T12:40:17.213546+0000 46'101 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213486+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210112+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:28.421786+0000 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213641+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.874 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213316+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211090+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211553+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210988+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:46.646108+0000 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211516+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211112+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.211719+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213105+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.213523+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:40:17.210815+0000 30'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 user requested scrub scheduled @ 2026-02-19T12:41:44.675097+0000 0 0 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:03.875 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:03.876 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:03.881 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-19T12:41:03.882 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:41:03.882 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:41:03.882 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:41:03.882 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:03.882 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:03.883 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:41:03.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-19T12:41:03.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T12:41:03.937 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:41:03.943 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-19T12:41:04.266 INFO:tasks.workunit.client.0.trial109.stderr:noup is unset 2026-02-19T12:41:04.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-19T12:41:04.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:04.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:41:04.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:04.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:04.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:04.282 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:04.282 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:04.282 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:04.283 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:41:04.501 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 37 up_thru 45 down_at 31 last_clean_interval [5,30) [v2:127.0.0.1:6802/2201245360,v1:127.0.0.1:6803/2201245360] [v2:127.0.0.1:6804/2201245360,v1:127.0.0.1:6805/2201245360] exists,up 622d3a9f-6590-4503-8abc-1d26518e854d 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:04.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:04.504 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:04.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:04.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:04.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:41:04.719 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 32 last_clean_interval [9,30) [v2:127.0.0.1:6818/4288097562,v1:127.0.0.1:6819/4288097562] [v2:127.0.0.1:6820/4288097562,v1:127.0.0.1:6821/4288097562] exists,up 9a4d5109-2305-41d7-9ebb-56317741f015 2026-02-19T12:41:04.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:04.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:04.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:04.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-19T12:41:04.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:04.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:41:04.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:04.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:04.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:04.721 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:04.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:04.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:04.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:41:04.924 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 40 up_thru 0 down_at 33 last_clean_interval [14,30) [v2:127.0.0.1:6810/473666236,v1:127.0.0.1:6811/473666236] [v2:127.0.0.1:6812/473666236,v1:127.0.0.1:6813/473666236] exists,up 557f0114-bbbc-4956-a5dd-df55a9970c21 2026-02-19T12:41:04.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:04.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:04.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:04.926 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:41:05.120 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:05.120 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270801+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.120 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270836+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.120 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270701+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.120 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270395+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.120 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270978+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.120 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270732+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270759+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.273306+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272973+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272674+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272480+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270760+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270847+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272483+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272303+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270802+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.271017+0000 30'106 51:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272646+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272879+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272492+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.264592+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270682+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265594+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265189+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270661+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270906+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270780+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.272504+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264946+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265289+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264765+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265438+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:05.121 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:05.129 INFO:tasks.workunit.client.0.trial109.stdout:wait for peering 2026-02-19T12:41:05.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-19T12:41:05.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270801+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270836+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270701+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270395+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270978+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270732+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270759+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.273306+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272973+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272674+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272480+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270760+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270847+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272483+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272303+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270802+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.343 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.271017+0000 30'106 51:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272646+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272879+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272492+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.264592+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270682+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265594+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265189+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270661+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270906+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270780+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.272504+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264946+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265289+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264765+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265438+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:05.344 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:05.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.omb2QIlYmB 2026-02-19T12:41:05.381 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.omb2QIlYmB 2026-02-19T12:41:05.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.xJAogCLnU3 2026-02-19T12:41:05.384 INFO:tasks.workunit.client.0.trial109.stdout:killing divergent 1 2026-02-19T12:41:05.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-19T12:41:05.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270801+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270836+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270701+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270395+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270978+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270732+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.586 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270759+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.273306+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272973+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272674+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272480+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270760+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270847+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272483+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272303+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270802+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.271017+0000 30'106 51:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.587 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272646+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272879+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272492+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.264592+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270682+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265594+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265189+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270661+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270906+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270780+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.272504+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.588 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264946+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.589 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265289+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.589 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264765+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.589 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265438+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:05.589 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:05.589 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:05.589 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:05.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T12:41:05.595 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:41:05.595 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:41:05.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:41:05.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:41:05.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:41:05.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:41:05.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.16056.out 2026-02-19T12:41:05.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16056.out 2026-02-19T12:41:05.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T12:41:05.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T12:41:05.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T12:41:05.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T12:41:05.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T12:41:05.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16056.out 2026-02-19T12:41:05.882 INFO:tasks.workunit.client.0.trial109.stderr:Exporting 1.0 info 1.0( v 30'100 (30'90,30'100] local-lis/les=51/52 n=3 ec=22/22 lis/c=51/51 les/c/f=52/52/0 sis=51) 2026-02-19T12:41:05.883 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-19T12:41:05.883 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-19T12:41:05.883 INFO:tasks.workunit.client.0.trial109.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-19T12:41:05.883 INFO:tasks.workunit.client.0.trial109.stderr:Export successful 2026-02-19T12:41:05.883 INFO:tasks.workunit.client.0.trial109.stdout: marking collection for removal 2026-02-19T12:41:05.883 INFO:tasks.workunit.client.0.trial109.stdout:setting '_remove' omap key 2026-02-19T12:41:05.883 INFO:tasks.workunit.client.0.trial109.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-19T12:41:05.884 INFO:tasks.workunit.client.0.trial109.stderr:Remove successful 2026-02-19T12:41:05.981 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16056.out 2026-02-19T12:41:05.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T12:41:05.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T12:41:05.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T12:41:05.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T12:41:05.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T12:41:05.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16056.out 2026-02-19T12:41:06.148 INFO:tasks.workunit.client.0.trial109.stdout:get_pg_num_history pg_num_history pg_num_history(e52 pg_nums {1={22=1,45=32}} deleted_pools ) 2026-02-19T12:41:06.148 INFO:tasks.workunit.client.0.trial109.stdout:Importing pgid 1.0 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:snapset 0={} 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:write_pg epoch 52 info 1.0( v 30'100 (30'90,30'100] local-lis/les=51/52 n=3 ec=22/22 lis/c=51/51 les/c/f=52/52/0 sis=51) 2026-02-19T12:41:06.149 INFO:tasks.workunit.client.0.trial109.stdout:Import successful 2026-02-19T12:41:06.245 INFO:tasks.workunit.client.0.trial109.stdout:reviving divergent 1 2026-02-19T12:41:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-19T12:41:06.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:41:06.447 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270801+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270836+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270701+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270395+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270978+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270732+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270759+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.273306+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272973+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272674+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.448 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272480+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270760+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.270847+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272483+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272303+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270802+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.271017+0000 30'106 51:135 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272646+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272879+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.272492+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T12:41:04.264592+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.449 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270682+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265594+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265189+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270661+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270906+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.270780+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.272504+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264946+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265289+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.264765+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T12:41:04.265438+0000 30'106 52:136 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:06.450 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:06.451 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:06.459 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-19T12:41:06.459 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:41:06.459 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:41:06.459 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:41:06.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:41:06.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:41:06.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:41:06.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:41:06.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:41:06.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:41:06.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:41:06.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:41:06.463 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:41:06.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:41:06.464 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:41:06.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:41:06.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:41:06.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:41:06.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:41:06.482 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:06.473+0000 7f0e8b544a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:06.483 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:06.473+0000 7f0e8b544a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:06.484 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:06.473+0000 7f0e8b544a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:06.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:41:06.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:06.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:41:06.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:06.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:06.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:06.675 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:06.675 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:06.675 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:06.675 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:41:06.866 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:06.857+0000 7f0e8b544a40 -1 Falling back to public interface 2026-02-19T12:41:06.893 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 32 last_clean_interval [9,30) [v2:127.0.0.1:6818/4288097562,v1:127.0.0.1:6819/4288097562] [v2:127.0.0.1:6820/4288097562,v1:127.0.0.1:6821/4288097562] exists,up 9a4d5109-2305-41d7-9ebb-56317741f015 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:06.895 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:06.896 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:06.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:06.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:41:07.108 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 32 last_clean_interval [9,30) [v2:127.0.0.1:6818/4288097562,v1:127.0.0.1:6819/4288097562] [v2:127.0.0.1:6820/4288097562,v1:127.0.0.1:6821/4288097562] exists,up 9a4d5109-2305-41d7-9ebb-56317741f015 2026-02-19T12:41:07.109 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:07.109 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:07.109 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:07.109 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-19T12:41:07.604 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:07.593+0000 7f0e8b544a40 -1 osd.1 52 log_to_monitors true 2026-02-19T12:41:27.109 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-19T12:41:27.110 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:41:27.110 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:41:27.110 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:41:27.110 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:27.110 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:27.110 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:41:27.111 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-19T12:41:27.111 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.1.asok dump_ops_in_flight 2026-02-19T12:41:27.165 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:41:27.165 INFO:tasks.workunit.client.0.trial109.stdout: "ops": [], 2026-02-19T12:41:27.165 INFO:tasks.workunit.client.0.trial109.stdout: "num_ops": 0 2026-02-19T12:41:27.165 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:41:27.171 INFO:tasks.workunit.client.0.trial109.stdout:allowing recovery 2026-02-19T12:41:27.171 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-19T12:41:27.172 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:41:27.382 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:27.382 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.216287+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.382 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:15.214408+0000 30'100 63:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.382 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T12:41:24.535799+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:24.535731+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:21:59.490263+0000 4 0 2026-02-19T12:41:27.382 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:17.215484+0000 30'100 64:176 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.382 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-19T12:41:16.625828+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:16.625789+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:59:40.049616+0000 3 0 2026-02-19T12:41:27.382 INFO:tasks.workunit.client.0.trial109.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-19T12:41:21.537831+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:21.537782+0000 0'0 2026-02-19T12:39:26.705783+0000 0 1 periodic scrub scheduled @ 2026-02-20T21:50:43.106950+0000 5 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:15.565846+0000 30'100 64:187 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:15.565794+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:30:56.427994+0000 3 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.215481+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-19T12:41:15.214204+0000 52'101 63:166 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.5 6 0 0 0 0 3072 0 0 16 84 16 active+clean 2026-02-19T12:41:13.559683+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:13.559631+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:27:36.393107+0000 6 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:08.036632+0000 30'100 64:178 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:17.215767+0000 30'100 64:176 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-19T12:41:23.645822+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:23.645777+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:45:11.500538+0000 1 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-19T12:41:09.595202+0000 30'100 64:187 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:09.595146+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T15:04:02.959068+0000 3 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:13.215231+0000 30'100 67:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-19T12:41:10.629371+0000 30'100 64:186 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:10.629319+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:42:00.859939+0000 2 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:18.568786+0000 30'100 64:186 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:18.568740+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T18:14:33.322860+0000 3 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:13.215165+0000 30'100 67:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-19T12:41:15.213984+0000 46'101 63:175 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.383 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.215772+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:19.592241+0000 30'100 64:187 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:19.592192+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:42:23.072031+0000 3 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-19T12:41:17.570355+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:17.570295+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T12:42:43.560515+0000 3 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-19T12:41:19.657097+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:19.657046+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:13:29.047742+0000 1 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:21.598781+0000 30'100 64:184 [1,2,0] 1 [1,2,0] 1 30'100 2026-02-19T12:41:21.598729+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T14:58:24.982453+0000 3 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:08.036504+0000 30'100 64:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:13.215145+0000 30'100 67:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:15.214454+0000 30'100 63:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.215992+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:08.035353+0000 30'100 64:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-19T12:41:15.536533+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:15.536481+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:13:18.756244+0000 2 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T12:41:21.669639+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:21.669600+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T18:14:56.792006+0000 4 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:17.216134+0000 30'100 64:177 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:27.384 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:27.385 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:27.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-19T12:41:27.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T12:41:27.468 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:41:27.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-19T12:41:27.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T12:41:27.560 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:41:27.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-19T12:41:27.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T12:41:27.647 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:41:27.655 INFO:tasks.workunit.client.0.trial109.stdout:reading divergent objects 2026-02-19T12:41:27.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-19T12:41:27.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.216287+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:15.214408+0000 30'100 63:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T12:41:24.535799+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:24.535731+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:21:59.490263+0000 4 0 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:17.215484+0000 30'100 64:176 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-19T12:41:16.625828+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:16.625789+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:59:40.049616+0000 3 0 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-19T12:41:21.537831+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:21.537782+0000 0'0 2026-02-19T12:39:26.705783+0000 0 1 periodic scrub scheduled @ 2026-02-20T21:50:43.106950+0000 5 0 2026-02-19T12:41:27.873 INFO:tasks.workunit.client.0.trial109.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:15.565846+0000 30'100 64:187 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:15.565794+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:30:56.427994+0000 3 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.215481+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-19T12:41:15.214204+0000 52'101 63:166 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.5 6 0 0 0 0 3072 0 0 16 84 16 active+clean 2026-02-19T12:41:13.559683+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:13.559631+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:27:36.393107+0000 6 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:08.036632+0000 30'100 64:178 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:17.215767+0000 30'100 64:176 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-19T12:41:23.645822+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:23.645777+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:45:11.500538+0000 1 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-19T12:41:09.595202+0000 30'100 64:187 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:09.595146+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T15:04:02.959068+0000 3 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:13.215231+0000 30'100 67:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.1c 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-19T12:41:10.629371+0000 30'100 64:186 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:10.629319+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:42:00.859939+0000 2 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:18.568786+0000 30'100 64:186 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:18.568740+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T18:14:33.322860+0000 3 0 2026-02-19T12:41:27.874 INFO:tasks.workunit.client.0.trial109.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:13.215165+0000 30'100 67:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-19T12:41:15.213984+0000 46'101 63:175 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.215772+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:19.592241+0000 30'100 64:187 [1,0,2] 1 [1,0,2] 1 30'100 2026-02-19T12:41:19.592192+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:42:23.072031+0000 3 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-19T12:41:17.570355+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:17.570295+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T12:42:43.560515+0000 3 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-19T12:41:19.657097+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:19.657046+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:13:29.047742+0000 1 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.13 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T12:41:21.598781+0000 30'100 64:184 [1,2,0] 1 [1,2,0] 1 30'100 2026-02-19T12:41:21.598729+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T14:58:24.982453+0000 3 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:08.036504+0000 30'100 64:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:13.215145+0000 30'100 67:161 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:15.214454+0000 30'100 63:174 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T12:41:17.215992+0000 30'100 64:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:08.035353+0000 30'100 64:179 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.875 INFO:tasks.workunit.client.0.trial109.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-19T12:41:15.536533+0000 30'100 67:169 [2,0,1] 2 [2,0,1] 2 30'100 2026-02-19T12:41:15.536481+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:13:18.756244+0000 2 0 2026-02-19T12:41:27.876 INFO:tasks.workunit.client.0.trial109.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T12:41:21.669639+0000 30'100 66:190 [0,1,2] 0 [0,1,2] 0 30'100 2026-02-19T12:41:21.669600+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 periodic scrub scheduled @ 2026-02-20T18:14:56.792006+0000 4 0 2026-02-19T12:41:27.876 INFO:tasks.workunit.client.0.trial109.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T12:41:17.216134+0000 30'100 64:177 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T12:39:26.705783+0000 0'0 2026-02-19T12:39:26.705783+0000 0 0 queued for scrub 0 0 2026-02-19T12:41:27.876 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:27.876 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:27.876 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:27.882 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-19T12:41:27.883 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-19T12:41:27.884 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:41:27.884 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T12:41:27.907 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:41:27.907 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T12:41:27.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:41:27.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T12:41:27.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:41:27.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T12:41:27.992 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-19T12:41:27.993 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:41:27.993 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-19T12:41:28.012 INFO:tasks.workunit.client.0.trial109.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-19T12:41:28.014 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T12:41:28.015 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-19T12:41:28.041 INFO:tasks.workunit.client.0.trial109.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-19T12:41:28.043 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-19T12:41:28.044 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-19T12:41:28.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:41:28.049 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 30'104 (30'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-19T12:39:41.258032+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:41:28.049 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 20 _merge_object_divergent_entries: keeping 30'104 (30'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-19T12:39:41.258032+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 30'2 first_divergent_update: 30'104 last_divergent_update: 30'104 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 30'106 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 30'104 (30'2) modify 1:97db2a0f:::existing_2:head by client.4542.0:1 2026-02-19T12:39:41.258032+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 30'2 <= info.log_tail 30'89 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 30'106 (30'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-19T12:39:41.264657+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 20 _merge_object_divergent_entries: keeping 30'106 (30'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-19T12:39:41.264657+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:41:28.050 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 30'4 first_divergent_update: 30'106 last_divergent_update: 30'106 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 10 _merge_object_divergent_entries: more recent entry found: 46'101 (30'4) modify 1:70b3bf12:::existing_4:head by client.4660.0:1 2026-02-19T12:40:28.031227+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 30'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4538.0:1 2026-02-19T12:39:41.257071+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 20 _merge_object_divergent_entries: keeping 30'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4538.0:1 2026-02-19T12:39:41.257071+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 30'101 last_divergent_update: 30'101 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.616+0000 7f80eb592640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 30'103 (30'1) modify 1:d858c035:::existing_1:head by client.4543.0:1 2026-02-19T12:39:41.257990+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 20 _merge_object_divergent_entries: keeping 30'103 (30'1) modify 1:d858c035:::existing_1:head by client.4543.0:1 2026-02-19T12:39:41.257990+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:41:28.051 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 30'1 first_divergent_update: 30'103 last_divergent_update: 30'103 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 30'106 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 30'103 (30'1) modify 1:d858c035:::existing_1:head by client.4543.0:1 2026-02-19T12:39:41.257990+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 30'1 <= info.log_tail 30'90 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 30'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4541.0:1 2026-02-19T12:39:41.257417+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:41:28.052 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 20 _merge_object_divergent_entries: keeping 30'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4541.0:1 2026-02-19T12:39:41.257417+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:41:28.057 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 30'102 last_divergent_update: 30'102 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80ecd95640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 30'105 (30'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T12:39:41.261177+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 20 _merge_object_divergent_entries: keeping 30'105 (30'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T12:39:41.261177+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 30'3 first_divergent_update: 30'105 last_divergent_update: 30'105 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-19T12:41:28.058 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:41:28.059 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 30'106 2026-02-19T12:41:28.059 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 30'105 (30'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T12:39:41.261177+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T12:41:28.059 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-19T12:41:28.059 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:41:04.620+0000 7f80e9d8f640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 30'3 <= info.log_tail 30'84 2026-02-19T12:41:28.059 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-19T12:41:28.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:41:28.062 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-19T12:41:28.063 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:41:28.066 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-19T12:41:28.066 INFO:tasks.workunit.client.0.trial109.stdout:success 2026-02-19T12:41:28.066 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.16056.out 2026-02-19T12:41:28.067 INFO:tasks.workunit.client.0.trial109.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16056.out': No such file or directory 2026-02-19T12:41:28.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-19T12:41:28.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T12:41:28.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T12:41:28.330 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' does not exist 2026-02-19T12:41:28.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-19T12:41:28.340 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:41:28.340 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:41:28.340 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:41:28.341 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:41:28.341 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:41:33.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:41:33.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T12:41:33.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:41:33.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:41:33.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:41:33.657 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:41:33.658 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:41:33.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:41:33.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:41:33.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:41:33.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:41:33.664 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:41:33.665 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:41:33.666 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:41:33.667 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:41:33.667 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:41:33.667 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:41:33.668 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:41:33.668 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:41:33.669 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:41:33.669 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:41:33.670 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:41:33.671 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:41:33.671 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:41:33.700 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:41:33.701 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:33.701 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:33.701 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:41:33.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:41:33.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:41:33.704 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:41:33.704 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:41:33.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:41:33.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:41:33.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:41:33.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:41:33.706 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:41:33.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:41:33.707 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:41:33.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:41:33.708 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:41:33.708 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:41:33.709 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:41:33.709 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:41:33.710 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:41:33.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:41:33.711 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:41:33.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:41:33.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:41:33.714 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:41:33.714 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:33.714 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:33.714 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:41:33.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:41:33.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:41:33.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T12:41:33.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:41:33.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:33.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:33.717 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16056 2026-02-19T12:41:33.718 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:41:33.719 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T12:41:33.719 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:41:33.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T12:41:33.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-19T12:41:33.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-19T12:41:33.720 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-19T12:41:33.720 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-19T12:41:33.720 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-19T12:41:33.721 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:33.721 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.g9oZb0g2PE bs=512 count=1 2026-02-19T12:41:33.722 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:41:33.722 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:41:33.722 INFO:tasks.workunit.client.0.trial109.stderr:512 bytes copied, 5.5788e-05 s, 9.2 MB/s 2026-02-19T12:41:33.722 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:33.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:33.723 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-19T12:41:33.723 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-19T12:41:33.723 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-19T12:41:33.724 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.s7YZQxeD5x 2026-02-19T12:41:33.724 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.s7YZQxeD5x bs=1000 count=1 2026-02-19T12:41:33.725 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records in 2026-02-19T12:41:33.725 INFO:tasks.workunit.client.0.trial109.stderr:1+0 records out 2026-02-19T12:41:33.725 INFO:tasks.workunit.client.0.trial109.stderr:1000 bytes (1.0 kB) copied, 7.778e-05 s, 12.9 MB/s 2026-02-19T12:41:33.725 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.s7YZQxeD5x 2026-02-19T12:41:33.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.s7YZQxeD5x 2026-02-19T12:41:33.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-19T12:41:33.726 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-19T12:41:33.727 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:41:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T12:41:33.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T12:41:33.753 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:41:33.753 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:41:33.753 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:41:33.754 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:41:33.754 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:33.754 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:33.754 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:33.754 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:41:33.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:41:33.784 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:41:33.785 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:41:33.785 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:41:33.785 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:41:33.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:41:33.786 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:41:33.786 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:41:33.786 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:41:33.786 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:41:33.786 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:33.787 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:33.787 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:41:33.787 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:41:33.787 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get fsid 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:41:33.843 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:41:33.844 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:41:33.844 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:33.845 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:33.845 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-mon.a.asok 2026-02-19T12:41:33.845 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:41:33.845 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16056/ceph-mon.a.asok config get mon_host 2026-02-19T12:41:33.898 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-19T12:41:33.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T12:41:33.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:41:33.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:41:33.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:41:33.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T12:41:33.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:41:34.026 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:41:34.026 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:41:34.026 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:41:34.026 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:41:34.026 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:34.027 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:34.027 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:34.027 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:41:34.028 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:41:34.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:34.054 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:41:34.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:41:34.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:41:34.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:41:34.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=94e97762-78b5-4e59-a050-ab5918b006f1 2026-02-19T12:41:34.057 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 94e97762-78b5-4e59-a050-ab5918b006f1 2026-02-19T12:41:34.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 94e97762-78b5-4e59-a050-ab5918b006f1' 2026-02-19T12:41:34.057 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:41:34.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD+BJdpyv/cAxAAYaVtyULSjPVxBhU8rX4n8w== 2026-02-19T12:41:34.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD+BJdpyv/cAxAAYaVtyULSjPVxBhU8rX4n8w=="}' 2026-02-19T12:41:34.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 94e97762-78b5-4e59-a050-ab5918b006f1 -i td/divergent-priors/0/new.json 2026-02-19T12:41:34.181 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:34.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T12:41:34.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD+BJdpyv/cAxAAYaVtyULSjPVxBhU8rX4n8w== --osd-uuid 94e97762-78b5-4e59-a050-ab5918b006f1 2026-02-19T12:41:34.209 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:34.201+0000 7f2f2cd0ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:34.211 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:34.201+0000 7f2f2cd0ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:34.212 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:34.205+0000 7f2f2cd0ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:34.212 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:34.205+0000 7f2f2cd0ea40 -1 bdev(0x55cf2b6eac00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:41:34.212 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:34.205+0000 7f2f2cd0ea40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T12:41:34.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T12:41:34.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:41:34.992 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:41:34.992 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:41:34.992 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:41:35.283 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:41:35.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:41:35.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:41:35.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:41:35.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:41:35.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:41:35.313 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:35.305+0000 7fb1d3defa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:35.315 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:35.309+0000 7fb1d3defa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:35.317 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:35.309+0000 7fb1d3defa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:35.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:41:35.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:35.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:41:35.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:35.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:35.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:35.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:35.504 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:35.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:35.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:41:35.689 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:35.681+0000 7fb1d3defa40 -1 Falling back to public interface 2026-02-19T12:41:35.719 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:41:36.225 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:36.217+0000 7fb1d3defa40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:41:36.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:41:36.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:36.720 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:41:36.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:41:36.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:36.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:41:36.946 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1537042441,v1:127.0.0.1:6803/1537042441] [v2:127.0.0.1:6804/1537042441,v1:127.0.0.1:6805/1537042441] exists,up 94e97762-78b5-4e59-a050-ab5918b006f1 2026-02-19T12:41:36.949 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:36.949 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:36.949 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:41:36.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:36.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:41:36.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:41:36.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:41:36.953 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:41:36.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fb219d22-14c4-4a8d-9f7b-140fd863c482 2026-02-19T12:41:36.953 INFO:tasks.workunit.client.0.trial109.stdout:add osd1 fb219d22-14c4-4a8d-9f7b-140fd863c482 2026-02-19T12:41:36.954 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 fb219d22-14c4-4a8d-9f7b-140fd863c482' 2026-02-19T12:41:36.954 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:41:36.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAABZdpIqZIORAAOIWXqCpv+Z6FHE4y/Z1j9w== 2026-02-19T12:41:36.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAABZdpIqZIORAAOIWXqCpv+Z6FHE4y/Z1j9w=="}' 2026-02-19T12:41:36.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fb219d22-14c4-4a8d-9f7b-140fd863c482 -i td/divergent-priors/1/new.json 2026-02-19T12:41:37.189 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:41:37.198 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T12:41:37.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAABZdpIqZIORAAOIWXqCpv+Z6FHE4y/Z1j9w== --osd-uuid fb219d22-14c4-4a8d-9f7b-140fd863c482 2026-02-19T12:41:37.220 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:37.213+0000 7f7d73930a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:37.221 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:37.213+0000 7f7d73930a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:37.222 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:37.213+0000 7f7d73930a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:37.223 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:37.213+0000 7f7d73930a40 -1 bdev(0x55739817ec00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T12:41:37.223 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:37.217+0000 7f7d73930a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T12:41:37.838 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T12:41:37.838 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:41:37.839 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T12:41:37.839 INFO:tasks.workunit.client.0.trial109.stdout:adding osd1 key to auth repository 2026-02-19T12:41:37.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:41:38.131 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:41:38.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T12:41:38.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:41:38.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:41:38.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:41:38.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:41:38.161 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:38.153+0000 7fdd70c2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:38.163 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:38.153+0000 7fdd70c2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:38.164 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:38.157+0000 7fdd70c2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:38.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T12:41:38.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:38.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:41:38.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:38.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:38.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:38.352 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:38.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:38.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:38.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:41:38.521 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:38.513+0000 7fdd70c2ea40 -1 Falling back to public interface 2026-02-19T12:41:38.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:41:39.169 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:39.161+0000 7fdd70c2ea40 -1 osd.1 0 log_to_monitors true 2026-02-19T12:41:39.569 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:41:39.569 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:39.569 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:41:39.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:41:39.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:39.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:41:39.782 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/95910277,v1:127.0.0.1:6811/95910277] [v2:127.0.0.1:6812/95910277,v1:127.0.0.1:6813/95910277] exists,up fb219d22-14c4-4a8d-9f7b-140fd863c482 2026-02-19T12:41:39.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:39.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:39.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:39.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-19T12:41:39.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-19T12:41:39.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:41:39.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:41:39.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0becc3c7-672b-4972-8a2b-4ecf0a909752 2026-02-19T12:41:39.789 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0becc3c7-672b-4972-8a2b-4ecf0a909752' 2026-02-19T12:41:39.790 INFO:tasks.workunit.client.0.trial109.stdout:add osd2 0becc3c7-672b-4972-8a2b-4ecf0a909752 2026-02-19T12:41:39.790 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:41:39.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQADBZdpDnCALxAAhoCqu6lC7feztzShzdodlQ== 2026-02-19T12:41:39.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQADBZdpDnCALxAAhoCqu6lC7feztzShzdodlQ=="}' 2026-02-19T12:41:39.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0becc3c7-672b-4972-8a2b-4ecf0a909752 -i td/divergent-priors/2/new.json 2026-02-19T12:41:40.022 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:41:40.032 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T12:41:40.034 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADBZdpDnCALxAAhoCqu6lC7feztzShzdodlQ== --osd-uuid 0becc3c7-672b-4972-8a2b-4ecf0a909752 2026-02-19T12:41:40.063 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:40.057+0000 7f9203ad0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:40.065 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:40.057+0000 7f9203ad0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:40.066 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:40.057+0000 7f9203ad0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:40.066 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:40.057+0000 7f9203ad0a40 -1 bdev(0x55784ee22c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T12:41:40.066 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:40.057+0000 7f9203ad0a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T12:41:40.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T12:41:40.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:41:40.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T12:41:40.706 INFO:tasks.workunit.client.0.trial109.stdout:adding osd2 key to auth repository 2026-02-19T12:41:40.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:41:41.003 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:41:41.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T12:41:41.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:41:41.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:41:41.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:41:41.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:41:41.033 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:41.025+0000 7fa69f42fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:41.035 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:41.025+0000 7fa69f42fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:41.036 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:41.029+0000 7fa69f42fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:41:41.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T12:41:41.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:41:41.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:41:41.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:41:41.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:41:41.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:41.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:41:41.215 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:41:41.216 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:41.216 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:41:41.430 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:41:41.432 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:41.425+0000 7fa69f42fa40 -1 Falling back to public interface 2026-02-19T12:41:42.087 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:41:42.081+0000 7fa69f42fa40 -1 osd.2 0 log_to_monitors true 2026-02-19T12:41:42.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:41:42.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:42.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:41:42.432 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:41:42.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:42.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:41:42.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:41:43.644 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:41:43.645 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:41:43.645 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:41:43.645 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:41:43.645 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:41:43.645 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:41:43.859 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/335662030,v1:127.0.0.1:6819/335662030] [v2:127.0.0.1:6820/335662030,v1:127.0.0.1:6821/335662030] exists,up 0becc3c7-672b-4972-8a2b-4ecf0a909752 2026-02-19T12:41:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:41:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:41:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:41:43.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-19T12:41:44.152 INFO:tasks.workunit.client.0.trial109.stderr:noout is set 2026-02-19T12:41:44.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-19T12:41:44.455 INFO:tasks.workunit.client.0.trial109.stderr:noin is set 2026-02-19T12:41:44.467 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-19T12:41:44.762 INFO:tasks.workunit.client.0.trial109.stderr:nodown is set 2026-02-19T12:41:44.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-19T12:41:44.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: local pool_name=test 2026-02-19T12:41:44.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: shift 2026-02-19T12:41:44.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: local allow_overwrites=true 2026-02-19T12:41:44.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2525: create_ec_pool: shift 2026-02-19T12:41:44.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2527: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-19T12:41:45.030 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2529: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-19T12:41:45.030 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-19T12:41:45.424 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' already exists 2026-02-19T12:41:45.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:41:46.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: '[' true = true ']' 2026-02-19T12:41:46.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2532: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-19T12:41:46.780 INFO:tasks.workunit.client.0.trial109.stderr:set pool 1 allow_ec_overwrites to true 2026-02-19T12:41:46.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: wait_for_clean 2026-02-19T12:41:46.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:41:46.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:41:46.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:41:46.794 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:41:46.794 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:41:46.794 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:41:46.794 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:41:46.795 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:41:46.795 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:41:46.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:41:46.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:41:46.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:41:46.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:41:46.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:41:46.910 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:41:47.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:41:47.123 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:41:47.123 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:41:47.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:41:47.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:47.123 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:41:47.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-19T12:41:47.210 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-19T12:41:47.210 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-19T12:41:47.210 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:47.210 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:41:47.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-19T12:41:47.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-19T12:41:47.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705669' 2026-02-19T12:41:47.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:47.293 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:41:47.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-19T12:41:47.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-19T12:41:47.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705669 2-60129542147' 2026-02-19T12:41:47.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:47.376 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-19T12:41:47.376 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:47.376 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:41:47.377 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-19T12:41:47.377 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:47.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-19T12:41:47.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-19T12:41:47.379 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836485 2026-02-19T12:41:47.379 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:41:47.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-19T12:41:47.596 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:41:48.597 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:41:48.597 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:41:48.811 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836486 -lt 21474836485 2026-02-19T12:41:48.811 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:48.812 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-19T12:41:48.812 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:48.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:41:48.813 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705669 2026-02-19T12:41:48.814 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:48.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705669 2026-02-19T12:41:48.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-19T12:41:48.816 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705669 2026-02-19T12:41:48.816 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:41:49.029 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-19T12:41:49.029 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:49.030 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-19T12:41:49.030 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:49.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:41:49.032 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542147 2026-02-19T12:41:49.032 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:49.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542147 2026-02-19T12:41:49.034 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-19T12:41:49.034 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 60129542147 2026-02-19T12:41:49.034 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:41:49.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-19T12:41:49.260 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:41:49.261 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:41:49.261 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:41:49.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:41:49.550 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:41:49.550 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:41:49.550 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:41:49.550 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:41:49.550 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:41:49.550 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:41:49.551 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:41:49.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:41:49.763 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:41:49.763 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:41:49.763 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:41:50.045 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:41:50.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:41:50.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:41:50.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2536: create_ec_pool: return 0 2026-02-19T12:41:50.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-19T12:41:50.046 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:41:50.046 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:41:50.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:41:50.263 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:41:50.263 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:41:50.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:41:50.263 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:50.264 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:41:50.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-19T12:41:50.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-19T12:41:50.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488' 2026-02-19T12:41:50.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:50.346 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:41:50.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-19T12:41:50.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-19T12:41:50.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705672' 2026-02-19T12:41:50.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:50.426 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:41:50.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-19T12:41:50.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-19T12:41:50.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542150' 2026-02-19T12:41:50.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:50.506 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-19T12:41:50.506 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:50.507 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:41:50.507 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836488 2026-02-19T12:41:50.508 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:50.509 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836488 2026-02-19T12:41:50.509 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-19T12:41:50.509 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836488 2026-02-19T12:41:50.509 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:41:50.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-19T12:41:50.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:50.726 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-19T12:41:50.726 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:50.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:41:50.728 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705672 2026-02-19T12:41:50.728 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:50.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705672 2026-02-19T12:41:50.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-19T12:41:50.730 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705672 2026-02-19T12:41:50.730 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:41:50.943 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-19T12:41:50.943 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:50.943 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-19T12:41:50.944 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:50.945 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:41:50.945 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542150 2026-02-19T12:41:50.946 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:50.947 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542150 2026-02-19T12:41:50.947 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-19T12:41:50.947 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 60129542150 2026-02-19T12:41:50.948 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:41:51.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-19T12:41:51.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-19T12:41:51.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:41:51.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:41:51.168 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:41:51.168 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:41:51.169 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:41:51.169 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:41:51.169 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:41:51.169 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:41:51.169 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:41:51.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:41:51.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:41:51.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:41:51.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:41:51.277 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:41:51.277 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:41:51.492 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:41:51.493 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:41:51.493 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:41:51.493 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:41:51.493 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:51.493 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:41:51.574 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-19T12:41:51.574 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-19T12:41:51.574 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-19T12:41:51.574 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:51.574 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:41:51.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-19T12:41:51.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-19T12:41:51.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-19T12:41:51.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:51.656 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:41:51.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-19T12:41:51.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-19T12:41:51.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542152' 2026-02-19T12:41:51.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:51.734 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-19T12:41:51.734 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:51.735 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:41:51.736 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-19T12:41:51.736 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:51.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-19T12:41:51.737 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836490 2026-02-19T12:41:51.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-19T12:41:51.738 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:41:51.963 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-19T12:41:51.963 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:41:52.964 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:41:52.965 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:41:53.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836490 2026-02-19T12:41:53.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:53.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-19T12:41:53.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:53.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:41:53.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-19T12:41:53.190 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:53.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-19T12:41:53.191 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705674 2026-02-19T12:41:53.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-19T12:41:53.192 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:41:53.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-19T12:41:53.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:53.410 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-19T12:41:53.410 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:53.410 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:41:53.411 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542152 2026-02-19T12:41:53.411 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:53.412 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542152 2026-02-19T12:41:53.413 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-19T12:41:53.413 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 60129542152 2026-02-19T12:41:53.413 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:41:53.630 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542152 -lt 60129542152 2026-02-19T12:41:53.630 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:41:53.631 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:41:53.631 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:41:53.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:41:53.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:41:53.911 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:41:53.911 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:41:53.911 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:41:53.911 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:41:53.911 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:41:53.912 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:41:54.124 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:41:54.125 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:41:54.126 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:41:54.126 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:41:54.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:41:54.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:41:54.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:41:54.421 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-19T12:41:54.421 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-19T12:41:54.624 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:54.633 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-19T12:41:54.634 INFO:tasks.workunit.client.0.trial109.stdout:primary and soon to be divergent is 1 2026-02-19T12:41:54.634 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-19T12:41:54.634 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:41:54.834 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:41:54.834 INFO:tasks.workunit.client.0.trial109.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T12:41:46.070398+0000 0'0 27:16 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T22:22:10.927345+0000 0 0 2026-02-19T12:41:54.835 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:41:54.835 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:41:54.835 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:41:54.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-19T12:41:54.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-19T12:41:54.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-19T12:41:54.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-19T12:41:54.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-19T12:41:54.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-19T12:41:54.846 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-19T12:41:54.846 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-19T12:41:54.846 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-19T12:41:54.846 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-19T12:41:54.846 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-19T12:41:54.846 INFO:tasks.workunit.client.0.trial109.stdout:writing initial objects 2026-02-19T12:41:54.847 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-19T12:41:54.847 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:54.847 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:54.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:54.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:54.898 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:54.898 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:54.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:54.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:54.952 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:54.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:54.980 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:54.980 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:54.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:54.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.112 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.112 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.243 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.243 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.328 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.355 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.355 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.383 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.411 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.411 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.636 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.637 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.717 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.717 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.745 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.745 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.773 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.801 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.801 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.884 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.884 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.961 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.961 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:55.988 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:55.988 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.100 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.100 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.156 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.156 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.204 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.204 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.230 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.259 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.285 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.285 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.312 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.312 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.340 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.340 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.394 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.394 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.451 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.508 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.508 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.592 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.621 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.676 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.676 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.761 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.761 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.816 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.816 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.900 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.900 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.956 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.956 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:56.984 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:56.985 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.013 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.125 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.125 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.153 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.153 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.237 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.237 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.265 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.265 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.322 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.322 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.408 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.408 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.519 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T12:41:57.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:41:57.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:41:57.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-19T12:41:57.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:41:57.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:41:57.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:41:57.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:41:57.606 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:41:57.606 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:41:57.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:41:57.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:41:57.607 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:41:57.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:41:57.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:41:57.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:41:57.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:41:57.679 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:41:57.679 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:41:57.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:41:57.888 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:41:57.888 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:41:57.888 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:41:57.888 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:57.888 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:41:57.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-19T12:41:57.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-19T12:41:57.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836494' 2026-02-19T12:41:57.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:57.974 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:41:58.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705677 2026-02-19T12:41:58.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705677 2026-02-19T12:41:58.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836494 1-38654705677' 2026-02-19T12:41:58.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:41:58.055 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:41:58.137 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-19T12:41:58.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-19T12:41:58.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836494 1-38654705677 2-60129542155' 2026-02-19T12:41:58.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:58.138 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-19T12:41:58.139 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:58.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:41:58.140 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836494 2026-02-19T12:41:58.140 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:58.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836494 2026-02-19T12:41:58.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-19T12:41:58.142 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 21474836494 2026-02-19T12:41:58.142 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:41:58.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836494 2026-02-19T12:41:58.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:41:59.360 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:41:59.361 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:41:59.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-19T12:41:59.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:59.574 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705677 2026-02-19T12:41:59.574 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:59.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:41:59.575 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705677 2026-02-19T12:41:59.575 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:59.577 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705677 2026-02-19T12:41:59.577 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 38654705677 2026-02-19T12:41:59.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705677' 2026-02-19T12:41:59.578 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:41:59.802 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705677 -lt 38654705677 2026-02-19T12:41:59.802 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:41:59.803 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-19T12:41:59.803 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:41:59.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:41:59.804 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-60129542155 2026-02-19T12:41:59.805 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:41:59.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=60129542155 2026-02-19T12:41:59.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-19T12:41:59.806 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 60129542155 2026-02-19T12:41:59.807 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:42:00.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 60129542156 -lt 60129542155 2026-02-19T12:42:00.021 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:42:00.021 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:00.022 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:00.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:42:00.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:00.298 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:00.298 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:00.299 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:00.299 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:00.299 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:00.299 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:00.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:42:00.512 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:00.513 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:00.513 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:00.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:42:00.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:42:00.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:42:00.800 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-19T12:42:00.800 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T12:42:00.801 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T12:42:00.801 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T12:42:00.801 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T12:42:01.019 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-19T12:42:01.019 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-19T12:42:01.019 INFO:tasks.workunit.client.0.trial109.stdout:blackholing osds 0 2 2026-02-19T12:42:01.020 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:42:01.231 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:42:01.231 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T12:41:46.070398+0000 27'100 27:116 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T22:22:10.927345+0000 0 0 2026-02-19T12:42:01.231 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:42:01.231 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:42:01.232 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:42:01.240 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:01.241 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-19T12:42:01.241 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:42:01.241 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:42:01.242 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:42:01.242 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:42:01.242 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:42:01.243 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:42:01.243 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T12:42:01.243 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T12:42:01.297 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:42:01.297 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:42:01.297 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:42:01.303 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:01.304 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-19T12:42:01.304 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:42:01.304 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:42:01.304 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:42:01.304 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:42:01.304 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:42:01.304 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:42:01.305 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T12:42:01.305 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T12:42:01.357 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:42:01.357 INFO:tasks.workunit.client.0.trial109.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T12:42:01.357 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:42:01.363 INFO:tasks.workunit.client.0.trial109.stdout:writing divergent object 2026-02-19T12:42:01.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-19T12:42:01.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-19T12:42:01.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.s7YZQxeD5x 2026-02-19T12:42:02.365 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-19T12:42:02.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:42:02.438 INFO:tasks.workunit.client.0.trial109.stdout:created pool test snap snap1 2026-02-19T12:42:02.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-19T12:42:02.440 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-19T12:42:02.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.g9oZb0g2PE 2026-02-19T12:42:12.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-19T12:42:12.480 INFO:tasks.workunit.client.0.trial109.stderr:rados: no process found 2026-02-19T12:42:12.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-19T12:42:12.481 INFO:tasks.workunit.client.0.trial109.stdout:killing all the osds 2026-02-19T12:42:12.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:42:12.696 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:42:12.696 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-19T12:41:46.070398+0000 28'104 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:45:52.179113+0000 0 0 2026-02-19T12:42:12.696 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:42:12.696 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:42:12.697 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:42:12.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-19T12:42:12.706 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:42:12.706 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:42:12.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:42:12.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:42:12.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:42:12.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:42:12.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-19T12:42:12.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-19T12:42:13.074 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:42:13.083 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-19T12:42:13.083 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-19T12:42:13.358 INFO:tasks.workunit.client.0.trial109.stderr:osd.1 is already down. 2026-02-19T12:42:13.368 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-19T12:42:13.368 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-19T12:42:13.642 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already down. 2026-02-19T12:42:13.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:13.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-19T12:42:13.927 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already out. 2026-02-19T12:42:13.937 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:13.937 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-19T12:42:14.207 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already out. 2026-02-19T12:42:14.218 INFO:tasks.workunit.client.0.trial109.stdout:bringing up non_divergent 0 2 2026-02-19T12:42:14.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-19T12:42:14.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:42:14.427 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:42:14.427 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-19T12:41:46.070398+0000 28'104 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:45:52.179113+0000 0 0 2026-02-19T12:42:14.427 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:42:14.427 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:42:14.428 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:42:14.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:42:14.442 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:42:14.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:42:14.444 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:42:14.444 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:42:14.444 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:42:14.445 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:42:14.445 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T12:42:14.446 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:42:14.446 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:42:14.446 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:42:14.446 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:42:14.464 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:14.458+0000 7f98809b6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:14.465 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:14.458+0000 7f98809b6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:14.466 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:14.462+0000 7f98809b6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:14.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:42:14.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:42:14.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:42:14.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:42:14.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:42:14.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:42:14.663 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:42:14.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:42:14.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:42:14.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:42:14.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:42:14.907 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:14.902+0000 7f98809b6a40 -1 Falling back to public interface 2026-02-19T12:42:15.520 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:15.514+0000 7f98809b6a40 -1 osd.0 27 log_to_monitors true 2026-02-19T12:42:15.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:42:15.876 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:42:15.877 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:42:15.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:42:15.878 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:42:15.878 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:42:16.093 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,27) [v2:127.0.0.1:6802/3311069462,v1:127.0.0.1:6803/3311069462] [v2:127.0.0.1:6804/3311069462,v1:127.0.0.1:6805/3311069462] exists,up 94e97762-78b5-4e59-a050-ab5918b006f1 2026-02-19T12:42:16.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:42:16.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:42:16.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:42:16.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:16.098 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:42:16.099 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:42:16.100 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:42:16.101 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:42:16.101 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:42:16.101 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T12:42:16.101 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:42:16.101 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:42:16.101 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:42:16.101 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:42:16.118 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:16.114+0000 7f6f1dfa0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:16.119 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:16.114+0000 7f6f1dfa0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:16.120 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:16.114+0000 7f6f1dfa0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:16.307 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:42:16.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:42:16.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:42:16.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:42:16.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:42:16.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:42:16.308 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:42:16.308 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:42:16.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:42:16.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:42:16.504 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:16.498+0000 7f6f1dfa0a40 -1 Falling back to public interface 2026-02-19T12:42:16.528 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:42:17.126 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:17.122+0000 7f6f1dfa0a40 -1 osd.2 27 log_to_monitors true 2026-02-19T12:42:17.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:42:17.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:42:17.530 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:42:17.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:42:17.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:42:17.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:42:17.743 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,27) [v2:127.0.0.1:6810/861915475,v1:127.0.0.1:6811/861915475] [v2:127.0.0.1:6812/861915475,v1:127.0.0.1:6813/861915475] exists,up 0becc3c7-672b-4972-8a2b-4ecf0a909752 2026-02-19T12:42:17.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:42:17.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:42:17.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:42:17.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:17.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-19T12:42:17.989 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already in. 2026-02-19T12:42:17.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:17.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-19T12:42:18.290 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already in. 2026-02-19T12:42:18.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-19T12:42:23.303 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-19T12:42:23.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-19T12:42:23.305 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-19T12:42:23.305 INFO:tasks.workunit.client.0.trial109.stdout:writing non-divergent object existing_4 2026-02-19T12:42:23.305 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:42:23.503 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:42:23.504 INFO:tasks.workunit.client.0.trial109.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T12:42:18.338980+0000 27'100 42:126 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T16:10:54.392440+0000 0 0 2026-02-19T12:42:23.504 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:42:23.504 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:42:23.504 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:42:23.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.s7YZQxeD5x 2026-02-19T12:42:23.542 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.s7YZQxeD5x 2026-02-19T12:42:23.543 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:42:23.543 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-19T12:42:23.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:42:23.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:42:23.544 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:42:23.544 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:42:23.545 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:42:23.545 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:42:23.545 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:42:23.545 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:42:23.546 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:42:23.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:42:23.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:42:23.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:42:23.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:42:23.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:42:23.615 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:42:23.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:42:23.834 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:42:23.835 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:42:23.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:42:23.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:42:23.835 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:42:23.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855364 2026-02-19T12:42:23.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855364 2026-02-19T12:42:23.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855364' 2026-02-19T12:42:23.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:42:23.918 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:42:23.988 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:42:23.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:42:23.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:42:23.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:42:23.991 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:42:23.991 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:42:24.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757252 2026-02-19T12:42:24.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757252 2026-02-19T12:42:24.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855364 2-163208757252' 2026-02-19T12:42:24.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:42:24.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855364 2026-02-19T12:42:24.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:42:24.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:42:24.074 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-150323855364 2026-02-19T12:42:24.074 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:42:24.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855364 2026-02-19T12:42:24.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 150323855364' 2026-02-19T12:42:24.076 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 150323855364 2026-02-19T12:42:24.076 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:42:24.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855362 -lt 150323855364 2026-02-19T12:42:24.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:42:25.306 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:42:25.306 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:42:25.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855364 -lt 150323855364 2026-02-19T12:42:25.525 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:42:25.525 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757252 2026-02-19T12:42:25.525 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:42:25.526 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:42:25.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757252 2026-02-19T12:42:25.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:42:25.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757252 2026-02-19T12:42:25.529 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 163208757252 2026-02-19T12:42:25.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757252' 2026-02-19T12:42:25.530 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:42:25.743 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757252 -lt 163208757252 2026-02-19T12:42:25.743 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:42:25.744 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:25.744 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:26.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:42:26.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:26.023 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:26.023 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:26.023 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:26.023 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:26.023 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:26.023 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:26.236 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:26.237 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:26.237 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:26.237 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:26.526 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:26.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T12:42:26.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T12:42:26.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T12:42:26.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:26.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T12:42:26.627 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:26.627 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:26.628 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:26.629 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:26.629 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:26.629 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:26.629 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:26.629 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:26.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:26.842 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:26.842 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:26.842 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:27.122 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:27.122 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:27.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:27.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:27.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:27.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:27.123 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:27.123 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:27.124 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:27.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:27.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:27.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T12:42:27.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:27.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T12:42:27.599 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:27.600 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:27.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:27.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:27.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:27.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:27.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:27.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:27.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:27.808 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:27.808 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:27.808 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:28.087 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:28.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:28.363 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:28.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T12:42:28.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:28.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T12:42:28.764 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:28.765 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:28.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:28.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:28.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:28.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:28.766 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:28.766 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:28.972 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:28.973 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:28.973 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:28.973 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:29.248 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:29.249 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:29.522 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:29.523 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:29.523 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T12:42:29.523 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:29.523 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T12:42:30.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:30.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:30.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:30.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:30.326 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:30.326 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:30.326 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:30.326 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:30.534 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:30.534 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:30.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:30.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:30.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:30.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:30.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:30.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:30.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:30.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:30.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:30.814 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:30.814 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:31.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:31.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:31.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T12:42:31.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:31.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T12:42:32.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:32.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:32.698 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:32.698 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:32.698 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:32.698 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:32.698 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:32.698 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:32.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:32.905 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:32.905 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:32.905 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:33.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:33.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:33.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:33.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:33.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:33.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:33.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:33.187 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:33.187 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:33.473 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:33.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:33.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T12:42:33.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:33.474 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T12:42:36.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:36.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:36.674 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:36.674 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:36.674 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:36.674 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:36.675 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:36.675 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:36.888 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:36.889 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:36.889 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:36.889 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:37.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:37.175 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:37.175 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:37.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:37.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:37.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T12:42:37.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:37.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T12:42:43.865 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:43.865 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:43.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:43.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:43.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:43.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:43.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:43.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:44.083 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:44.084 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:44.084 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:44.084 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:44.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:44.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:44.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:44.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:44.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:44.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:44.371 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:44.372 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:44.372 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:44.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:44.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:44.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T12:42:44.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:42:44.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T12:42:51.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:42:51.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:42:51.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:42:51.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:42:51.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:42:51.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:42:51.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:42:51.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:42:52.172 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:42:52.173 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:42:52.173 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:42:52.173 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:42:52.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:42:52.465 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:42:52.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:42:52.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:42:52.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T12:42:52.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T12:42:53.021 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_fingerprint": "9effd647-ba32-4651-9560-5e046ebb048b", 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "version": "20.2.0-720-g2fc421c8", 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "commit": "2fc421c83f0b86ea21b9e4289cad0f7957e09eb1", 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "timestamp": "2026-02-19T12:42:53.019873+0000", 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "tag": "", 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "health": { 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "status": "HEALTH_WARN", 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "checks": { 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "OSDMAP_FLAGS": { 2026-02-19T12:42:53.022 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "count": 17 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [], 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "OSD_DOWN": { 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "message": "1 osds down", 2026-02-19T12:42:53.023 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: "message": "osd.1 (root=default,host=trial109) is down" 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: "PG_DEGRADED": { 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:42:53.024 INFO:tasks.workunit.client.0.trial109.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: "mutes": [] 2026-02-19T12:42:53.025 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_first_committed": 1, 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_last_committed": 1, 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "monmap": { 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:41:33.742080Z", 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:41:33.742080Z", 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release": 20, 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release_name": "tentacle", 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "election_strategy": 1, 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "disallowed_leaders": "", 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": false, 2026-02-19T12:42:53.026 INFO:tasks.workunit.client.0.trial109.stdout: "tiebreaker_mon": "", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "removed_ranks": "", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "features": { 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "persistent": [ 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "kraken", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "luminous", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "mimic", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap-prune", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "nautilus", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "octopus", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "pacific", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "elector-pinging", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "quincy", 2026-02-19T12:42:53.027 INFO:tasks.workunit.client.0.trial109.stdout: "reef", 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "squid", 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "tentacle", 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "nvmeof_beacon_diff" 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "optional": [] 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "mons": [ 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "rank": 0, 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "name": "a", 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:42:53.028 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115", 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 0 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "priority": 0, 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 0, 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: "crush_location": "{}" 2026-02-19T12:42:53.029 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "quorum": [ 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: 0 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap": { 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 42, 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:41:33.817937+0000", 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:42:18.336431+0000", 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "last_up_change": "2026-02-19T12:42:17.305109+0000", 2026-02-19T12:42:53.030 INFO:tasks.workunit.client.0.trial109.stdout: "last_in_change": "2026-02-19T12:42:18.234381+0000", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "flags_num": 5800384, 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "flags_set": [ 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "nodown", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "noin", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "noout", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "pglog_hardlimit", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snapdirs", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "recovery_deletes", 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "sortbitwise" 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "crush_version": 10, 2026-02-19T12:42:53.031 INFO:tasks.workunit.client.0.trial109.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_snapshot": "", 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "pool_max": 1, 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "max_osd": 3, 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "require_min_compat_client": "luminous", 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "min_compat_client": "jewel", 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "require_osd_release": "tentacle", 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "allow_crimson": false, 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "pools": [ 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.032 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "pool_name": "test", 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "create_time": "2026-02-19T12:41:45.273247+0000", 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "flags": 16389, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "type": 3, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "size": 3, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "min_size": 2, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "crush_rule": 1, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_count": 0, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_target": 0, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T12:42:53.033 INFO:tasks.workunit.client.0.trial109.stdout: "is_stretch_pool": false, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "object_hash": 2, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "pg_autoscale_mode": "off", 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num": 1, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num": 1, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num_target": 1, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_target": 1, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_pending": 1, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "last_pg_merge_meta": { 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "source_pgid": "0.0", 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "ready_epoch": 0, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_started": 0, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": 0, 2026-02-19T12:42:53.034 INFO:tasks.workunit.client.0.trial109.stdout: "source_version": "0'0", 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "target_version": "0'0" 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "last_change": "28", 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend": "0", 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "auid": 0, 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "snap_mode": "pool", 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "snap_seq": 1, 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "snap_epoch": 28, 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "pool_snaps": [ 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.035 INFO:tasks.workunit.client.0.trial109.stdout: "snapid": 1, 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "stamp": "2026-02-19T12:42:02.384420+0000", 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "name": "snap1" 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps": "[]", 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_bytes": 0, 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_objects": 0, 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "tiers": [], 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "tier_of": -1, 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "read_tier": -1, 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "write_tier": -1, 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "cache_mode": "none", 2026-02-19T12:42:53.036 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_bytes": 0, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_objects": 0, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_flush_age": 0, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_evict_age": 0, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profile": "myprofile", 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_params": { 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "type": "none" 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_period": 0, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_count": 0, 2026-02-19T12:42:53.037 INFO:tasks.workunit.client.0.trial109.stdout: "use_gmt_hitset": true, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "min_read_recency_for_promote": 0, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "min_write_recency_for_promote": 0, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_search_last_n": 0, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "grade_table": [], 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "stripe_width": 8192, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "expected_num_objects": 0, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "fast_read": false, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "nonprimary_shards": "{}", 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "options": {}, 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: "application_metadata": {} 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.038 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "osds": [ 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "94e97762-78b5-4e59-a050-ab5918b006f1", 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 5, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 27, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 35, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 41, 2026-02-19T12:42:53.039 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 29, 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6802", 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6803", 2026-02-19T12:42:53.040 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6804", 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.041 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6805", 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6808", 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.042 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6809", 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6806", 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.043 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6807", 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3311069462 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6803/3311069462", 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6805/3311069462", 2026-02-19T12:42:53.044 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6809/3311069462", 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6807/3311069462", 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "fb219d22-14c4-4a8d-9f7b-140fd863c482", 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "up": 0, 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:42:53.045 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 0, 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 0, 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 9, 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 23, 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 30, 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.046 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:42:53.047 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.048 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.049 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/95910277", 2026-02-19T12:42:53.050 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/95910277", 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/95910277", 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/95910277", 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "exists" 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "0becc3c7-672b-4972-8a2b-4ecf0a909752", 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:42:53.051 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 14, 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 27, 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 38, 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 0, 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 31, 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.052 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:42:53.053 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.054 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.055 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 861915475 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/861915475", 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/861915475", 2026-02-19T12:42:53.056 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/861915475", 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/861915475", 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "osd_xinfo": [ 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:42:13.018182+0000", 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:42:53.057 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:41:37.218154+0000", 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:42:13.299603+0000", 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:42:53.058 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:41:40.135907+0000", 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:42:13.585569+0000", 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:41:43.112207+0000", 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:42:53.059 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap": [], 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_items": [], 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_primaries": [], 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "pg_temp": [], 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "primary_temp": [], 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "blocklist": {}, 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "range_blocklist": {}, 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profiles": { 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "default": { 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "m": "2", 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:42:53.060 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "myprofile": { 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "crush-device-class": "", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "crush-failure-domain": "osd", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "crush-num-failure-domains": "0", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "crush-osds-per-failure-domain": "0", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "crush-root": "default", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "m": "1", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps_queue": [], 2026-02-19T12:42:53.061 INFO:tasks.workunit.client.0.trial109.stdout: "new_removed_snaps": [], 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "new_purged_snaps": [], 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "crush_node_flags": {}, 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "device_class_flags": {}, 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": { 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_enabled": false, 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_bucket_count": 0, 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "degraded_stretch_mode": 0, 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "recovering_stretch_mode": 0, 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_bucket": 0 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "osd_metadata": [ 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.062 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6804/3311069462,v1:127.0.0.1:6805/3311069462]", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T12:42:53.063 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:41:34.888310Z", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:42:53.064 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6802/3311069462,v1:127.0.0.1:6803/3311069462]", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/3311069462,v1:127.0.0.1:6809/3311069462]", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/3311069462,v1:127.0.0.1:6807/3311069462]", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:42:53.065 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/95910277,v1:127.0.0.1:6813/95910277]", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:42:53.066 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:42:53.067 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:41:37.740309Z", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/95910277,v1:127.0.0.1:6811/95910277]", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/95910277,v1:127.0.0.1:6817/95910277]", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/95910277,v1:127.0.0.1:6815/95910277]", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:42:53.068 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/861915475,v1:127.0.0.1:6813/861915475]", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:42:53.069 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:42:53.070 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:41:40.608080Z", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/861915475,v1:127.0.0.1:6811/861915475]", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/861915475,v1:127.0.0.1:6817/861915475]", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/861915475,v1:127.0.0.1:6815/861915475]", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:42:53.071 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_clean_epochs": { 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "min_last_epoch_clean": 0, 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": { 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "per_pool": [] 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "osd_epochs": [ 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 35 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:42:53.072 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 39 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_first_committed": 1, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_last_committed": 42, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "crushmap": { 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "devices": [ 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.0", 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.1", 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:42:53.073 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.2", 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "types": [ 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 0, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd" 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "name": "host" 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 2, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "name": "chassis" 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 3, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: "name": "rack" 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.074 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 4, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "name": "row" 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 5, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pdu" 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 6, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pod" 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 7, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "name": "room" 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 8, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "name": "datacenter" 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.075 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 9, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "name": "zone" 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 10, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "name": "region" 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "name": "root" 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "buckets": [ 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "id": -1, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default", 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:42:53.076 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "id": -2, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default~ssd", 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.077 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109", 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:42:53.078 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109~ssd", 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.079 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "rules": [ 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 0, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "replicated_rule", 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_firstn", 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.080 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 1, 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "test", 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "type": 3, 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "op": "set_chooseleaf_tries", 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "num": 5 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "op": "set_choose_tries", 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "num": 100 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_indep", 2026-02-19T12:42:53.081 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: "tunables": { 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stderr:report 3114665804 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_tries": 0, 2026-02-19T12:42:53.082 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_fallback_tries": 0, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "choose_total_tries": 50, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_descend_once": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_vary_r": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_stable": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "msr_descents": 100, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "msr_collision_tries": 100, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "straw_calc_version": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "allowed_bucket_algs": 54, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "profile": "jewel", 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_tunables": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "legacy_tunables": 0, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "minimum_required_version": "jewel", 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables2": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "has_v2_rules": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables3": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "has_v3_rules": 0, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "has_v4_buckets": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables5": 1, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "has_v5_rules": 0, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "has_msr_rules": 0 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "choose_args": {} 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.083 INFO:tasks.workunit.client.0.trial109.stdout: "fsmap": { 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "btime": "2026-02-19T12:41:33:817760+0000", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "default_fscid": -1, 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "compat": { 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "compat": {}, 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "ro_compat": {}, 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "incompat": { 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_1": "base v0.20", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_2": "client writeable ranges", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_4": "dir inode in separate object", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_8": "no anchor table", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_9": "file layout v2", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_10": "snaprealm v2", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_11": "minor log segments", 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "feature_flags": { 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "enable_multiple": true, 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "ever_enabled_multiple": true 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.084 INFO:tasks.workunit.client.0.trial109.stdout: "standbys": [], 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "filesystems": [] 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_first_committed": 1, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_last_committed": 1, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "auth": { 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 5, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_secrets": 3 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_active": 1, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_unknown": 0, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_osd": 3, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "pool_sum": { 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 52200, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 101, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 1, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 303, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 101, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 101, 2026-02-19T12:42:53.085 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:42:53.086 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 18, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 18, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "up": 3, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 3, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 0 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum": { 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:42:53.087 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83908, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2132, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 25, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81702, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488892, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036625408, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2183168, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 1541698, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 25764, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83663708 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:42:53.088 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum_by_class": { 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "ssd": { 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 83908, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2132, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 25, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 81702, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314488892, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322036625408, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2183168, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 1541698, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:42:53.089 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 25764, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 83663708 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "pool_stats": [ 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 52200, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 101, 2026-02-19T12:42:53.090 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 1, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 303, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 101, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 101, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:42:53.091 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 1241088, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 1241088, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 18, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 18, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "up": 3, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 3, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 3 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "osd_stats": [ 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:42:53.092 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 150323855370 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 38654705680 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 163208757258 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_state": [ 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded", 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "num": 1 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "pool_pg_unavailable_map": [ 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": "1", 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "pgs": [] 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_osd": [ 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2147483647, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.093 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 1, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 0, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": [ 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": {} 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "servicemap": { 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 3, 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:42:40.530659+0000", 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "services": { 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "osd": { 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "daemons": { 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "summary": "", 2026-02-19T12:42:53.094 INFO:tasks.workunit.client.0.trial109.stdout: "0": { 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "2": { 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_first_committed": 1, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_last_committed": 40, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "logm_first_committed": 1, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "logm_last_committed": 228, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "paxos": { 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 320, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "last_pn": 0, 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: "accepted_pn": 0 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:42:53.095 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:42:53.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-19T12:42:53.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-19T12:42:53.322 INFO:tasks.workunit.client.0.trial109.stderr:PG '1.0' not found 2026-02-19T12:42:53.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-19T12:42:53.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-19T12:42:53.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:42:53.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:42:53.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:42:53.435 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:42:53.436 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:42:53.437 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:42:53.437 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:42:53.437 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:42:53.437 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:42:53.438 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:53.438 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:53.438 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:42:53.438 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:42:53.438 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T12:42:53.439 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:42:53.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:42:53.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:42:53.441 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T12:42:53.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:42:53.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:42:53.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:42:53.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:42:53.459 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:53.453+0000 7fa9e2316a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:53.460 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:53.453+0000 7fa9e2316a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:53.461 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:53.453+0000 7fa9e2316a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:53.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:42:53.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:42:53.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:42:53.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:42:53.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:42:53.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:42:53.649 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:42:53.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:42:53.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:42:53.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:42:53.803 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:53.797+0000 7fa9e2316a40 -1 Falling back to public interface 2026-02-19T12:42:53.860 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 35 up_thru 41 down_at 29 last_clean_interval [5,27) [v2:127.0.0.1:6802/3311069462,v1:127.0.0.1:6803/3311069462] [v2:127.0.0.1:6804/3311069462,v1:127.0.0.1:6805/3311069462] exists,up 94e97762-78b5-4e59-a050-ab5918b006f1 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:42:53.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:42:53.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:42:53.863 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:42:53.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:42:53.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-19T12:42:53.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T12:42:53.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T12:42:53.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-19T12:42:53.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T12:42:53.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-19T12:42:53.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-19T12:42:54.138 INFO:tasks.workunit.client.0.trial109.stderr:PG '1.0' not found 2026-02-19T12:42:54.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-19T12:42:54.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-19T12:42:54.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:42:54.222 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:42:54.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:42:54.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T12:42:54.225 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:42:54.225 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:42:54.225 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:42:54.225 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T12:42:54.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:42:54.227 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:42:54.227 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:42:54.227 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:42:54.248 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:54.241+0000 7f698c5e2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:54.250 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:54.245+0000 7f698c5e2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:54.251 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:54.245+0000 7f698c5e2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:42:54.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:42:54.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:42:54.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:42:54.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:42:54.436 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:42:54.437 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:42:54.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:42:54.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:42:54.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:42:54.437 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:42:54.502 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:54.497+0000 7fa9e2316a40 -1 osd.0 42 log_to_monitors true 2026-02-19T12:42:54.646 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,27) [v2:127.0.0.1:6810/861915475,v1:127.0.0.1:6811/861915475] [v2:127.0.0.1:6812/861915475,v1:127.0.0.1:6813/861915475] exists,up 0becc3c7-672b-4972-8a2b-4ecf0a909752 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T12:42:54.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T12:42:54.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-19T12:42:54.649 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:54.641+0000 7f698c5e2a40 -1 Falling back to public interface 2026-02-19T12:42:54.859 INFO:tasks.workunit.client.0.trial109.stderr:PG '1.0' not found 2026-02-19T12:42:54.974 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-19T12:42:54.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T12:42:54.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-19T12:42:54.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:42:54.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:42:54.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:42:54.975 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T12:42:54.976 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:42:54.976 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:42:54.976 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:42:54.976 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:42:54.976 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:42:55.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T12:42:55.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:42:55.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:42:55.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:42:55.033 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:42:55.033 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:42:55.253 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:42:55.253 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:42:55.253 INFO:tasks.workunit.client.0.trial109.stderr:2' 2026-02-19T12:42:55.253 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:42:55.253 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:42:55.253 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:42:55.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528323 2026-02-19T12:42:55.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528323 2026-02-19T12:42:55.334 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-193273528323' 2026-02-19T12:42:55.335 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:42:55.335 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:42:55.396 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:42:55.398 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:42:55.398 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:42:55.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:42:55.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:42:55.399 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:42:55.445 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:42:55.437+0000 7f698c5e2a40 -1 osd.2 42 log_to_monitors true 2026-02-19T12:43:00.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=210453397507 2026-02-19T12:43:00.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 210453397507 2026-02-19T12:43:00.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-193273528323 2-210453397507' 2026-02-19T12:43:00.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:43:00.481 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-193273528323 2026-02-19T12:43:00.481 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:43:00.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:43:00.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-193273528323 2026-02-19T12:43:00.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:43:00.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=193273528323 2026-02-19T12:43:00.484 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 193273528323 2026-02-19T12:43:00.485 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2026-02-19T12:43:00.485 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:43:00.709 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 193273528324 -lt 193273528323 2026-02-19T12:43:00.709 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:43:00.709 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-210453397507 2026-02-19T12:43:00.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:43:00.710 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:43:00.711 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-210453397507 2026-02-19T12:43:00.711 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:43:00.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=210453397507 2026-02-19T12:43:00.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 210453397507' 2026-02-19T12:43:00.713 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 210453397507 2026-02-19T12:43:00.713 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:43:00.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 210453397508 -lt 210453397507 2026-02-19T12:43:00.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:43:00.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:00.924 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:01.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:43:01.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:01.201 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:01.201 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:01.201 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:01.201 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:01.201 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:01.201 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:01.408 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:01.409 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:01.409 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:01.409 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:01.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:01.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T12:43:01.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T12:43:01.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T12:43:01.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:01.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T12:43:01.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:01.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:01.785 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:01.785 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:01.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:01.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:01.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:01.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:01.995 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:01.996 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:01.996 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:01.996 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:02.272 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:02.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:02.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:02.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:02.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:02.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:02.274 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:02.274 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:02.274 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:02.562 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:02.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:02.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T12:43:02.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:02.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T12:43:02.763 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:02.764 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:02.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:02.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:02.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:02.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:02.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:02.765 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:02.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:02.976 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:02.976 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:02.976 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:03.256 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:03.257 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:03.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:03.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:03.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T12:43:03.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:03.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T12:43:03.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:03.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:03.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:03.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:03.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:03.951 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:03.952 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:03.952 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:04.166 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:04.167 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:04.167 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:04.168 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:04.453 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:04.454 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:04.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:04.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:04.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T12:43:04.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:04.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T12:43:05.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:05.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:05.538 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:05.539 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:05.539 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:05.539 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:05.539 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:05.539 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:05.748 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:05.749 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:05.750 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:05.750 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:06.027 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:06.028 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:06.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:06.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:06.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T12:43:06.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:06.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T12:43:07.904 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:07.905 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:07.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:07.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:07.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:07.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:07.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:07.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:08.122 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:08.123 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:08.123 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:08.123 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:08.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:08.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:08.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:08.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:08.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:08.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:08.415 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:08.416 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:08.416 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:08.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:08.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:08.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T12:43:08.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:08.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T12:43:11.906 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:11.906 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:11.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:11.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:11.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:11.906 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:11.907 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:11.907 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:12.120 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:12.121 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:12.121 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:12.122 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:12.409 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:12.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:12.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:12.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T12:43:12.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:12.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T12:43:19.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:19.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:19.107 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:19.108 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:19.108 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:19.108 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:19.108 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:19.108 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:19.322 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:19.323 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:19.323 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:19.323 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:19.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:19.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:19.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:19.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:19.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:19.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:19.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:19.608 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:19.608 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:19.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:19.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:19.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T12:43:19.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T12:43:19.887 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T12:43:27.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T12:43:27.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:43:27.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:43:27.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:43:27.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:43:27.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:43:27.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:43:27.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:43:27.407 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T12:43:27.408 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:43:27.408 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:43:27.408 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:43:27.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T12:43:27.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T12:43:27.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T12:43:27.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T12:43:27.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T12:43:27.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T12:43:27.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T12:43:27.687 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T12:43:27.687 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T12:43:27.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T12:43:27.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T12:43:27.962 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T12:43:27.963 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_fingerprint": "9effd647-ba32-4651-9560-5e046ebb048b", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "version": "20.2.0-720-g2fc421c8", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "commit": "2fc421c83f0b86ea21b9e4289cad0f7957e09eb1", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "timestamp": "2026-02-19T12:43:28.237707+0000", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "tag": "", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "health": { 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "status": "HEALTH_WARN", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "checks": { 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "OSDMAP_FLAGS": { 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "count": 17 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [], 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "OSD_DOWN": { 2026-02-19T12:43:28.239 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "message": "1 osds down", 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "message": "osd.1 (root=default,host=trial109) is down" 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "PG_DEGRADED": { 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "severity": "HEALTH_WARN", 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "summary": { 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "count": 1 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "detail": [ 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "muted": false 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "mutes": [] 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_first_committed": 1, 2026-02-19T12:43:28.240 INFO:tasks.workunit.client.0.trial109.stdout: "monmap_last_committed": 1, 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "monmap": { 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:41:33.742080Z", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:41:33.742080Z", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release": 20, 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "min_mon_release_name": "tentacle", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "election_strategy": 1, 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "disallowed_leaders": "", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": false, 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "tiebreaker_mon": "", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "removed_ranks": "", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "features": { 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "persistent": [ 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "kraken", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "luminous", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "mimic", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap-prune", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "nautilus", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "octopus", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "pacific", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "elector-pinging", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "quincy", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "reef", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "squid", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "tentacle", 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "nvmeof_beacon_diff" 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "optional": [] 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.241 INFO:tasks.workunit.client.0.trial109.stdout: "mons": [ 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "rank": 0, 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "name": "a", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 0 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "priority": 0, 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 0, 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "crush_location": "{}" 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "quorum": [ 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: 0 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap": { 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 50, 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "fsid": "f7c03ea7-0879-45b6-bbe6-eab8c305991d", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "created": "2026-02-19T12:41:33.817937+0000", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:42:55.830068+0000", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "last_up_change": "2026-02-19T12:42:55.728200+0000", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "last_in_change": "2026-02-19T12:42:18.234381+0000", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T12:43:28.242 INFO:tasks.workunit.client.0.trial109.stdout: "flags_num": 5800384, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "flags_set": [ 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "nodown", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "noin", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "noout", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "pglog_hardlimit", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snapdirs", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "recovery_deletes", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "sortbitwise" 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "crush_version": 12, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_snapshot": "", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "pool_max": 1, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "max_osd": 3, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "require_min_compat_client": "luminous", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "min_compat_client": "jewel", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "require_osd_release": "tentacle", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "allow_crimson": false, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "pools": [ 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "pool_name": "test", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "create_time": "2026-02-19T12:41:45.273247+0000", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "flags": 16389, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "type": 3, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "size": 3, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "min_size": 2, 2026-02-19T12:43:28.243 INFO:tasks.workunit.client.0.trial109.stdout: "crush_rule": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_count": 0, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_target": 0, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "is_stretch_pool": false, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "object_hash": 2, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "pg_autoscale_mode": "off", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "pg_placement_num_target": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_target": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "pg_num_pending": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "last_pg_merge_meta": { 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "source_pgid": "0.0", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "ready_epoch": 0, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_started": 0, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": 0, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "source_version": "0'0", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "target_version": "0'0" 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "last_change": "28", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend": "0", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "auid": 0, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "snap_mode": "pool", 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "snap_seq": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "snap_epoch": 28, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "pool_snaps": [ 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "snapid": 1, 2026-02-19T12:43:28.244 INFO:tasks.workunit.client.0.trial109.stdout: "stamp": "2026-02-19T12:42:02.384420+0000", 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "name": "snap1" 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps": "[]", 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_bytes": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "quota_max_objects": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "tiers": [], 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "tier_of": -1, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "read_tier": -1, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "write_tier": -1, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "cache_mode": "none", 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_bytes": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "target_max_objects": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_flush_age": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "cache_min_evict_age": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profile": "myprofile", 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_params": { 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "type": "none" 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_period": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_count": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "use_gmt_hitset": true, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "min_read_recency_for_promote": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "min_write_recency_for_promote": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "hit_set_search_last_n": 0, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "grade_table": [], 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "stripe_width": 8192, 2026-02-19T12:43:28.245 INFO:tasks.workunit.client.0.trial109.stdout: "expected_num_objects": 0, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "fast_read": false, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "nonprimary_shards": "{}", 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "options": {}, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "application_metadata": {} 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "osds": [ 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "94e97762-78b5-4e59-a050-ab5918b006f1", 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 35, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 42, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 45, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 49, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 44, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6802", 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6803", 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.246 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6804", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6805", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6808", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6809", 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.247 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6806", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6807", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 3155133636 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6803/3155133636", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6805/3155133636", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6809/3155133636", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6807/3155133636", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "fb219d22-14c4-4a8d-9f7b-140fd863c482", 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "up": 0, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 0, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 0, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 9, 2026-02-19T12:43:28.248 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 23, 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 30, 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:43:28.249 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 95910277 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/95910277", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/95910277", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/95910277", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/95910277", 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: "exists" 2026-02-19T12:43:28.250 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "uuid": "0becc3c7-672b-4972-8a2b-4ecf0a909752", 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "up": 1, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "in": 1, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 1, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "primary_affinity": 1, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_begin": 38, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "last_clean_end": 42, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 49, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "up_thru": 0, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "down_at": 48, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "lost_at": 0, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "public_addrs": { 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6810", 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6811", 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addrs": { 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.251 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6812", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6813", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addrs": { 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6816", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6817", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addrs": { 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "addrvec": [ 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v2", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6814", 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.252 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "type": "v1", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "127.0.0.1:6815", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "nonce": 4070559616 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "public_addr": "127.0.0.1:6811/4070559616", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "cluster_addr": "127.0.0.1:6813/4070559616", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4070559616", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4070559616", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "state": [ 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "exists", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "up" 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "osd_xinfo": [ 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:42:54.628992+0000", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:41:37.218154+0000", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:42:13.299603+0000", 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:43:28.253 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:41:40.135907+0000", 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "down_stamp": "2026-02-19T12:42:55.626326+0000", 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_probability": 0, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "laggy_interval": 0, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "features": 4544132024016699391, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "old_weight": 0, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "last_purged_snaps_scrub": "2026-02-19T12:41:43.112207+0000", 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "dead_epoch": 0 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap": [], 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_items": [], 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "pg_upmap_primaries": [], 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "pg_temp": [], 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "primary_temp": [], 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "blocklist": {}, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "range_blocklist": {}, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "erasure_code_profiles": { 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "default": { 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "m": "2", 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "myprofile": { 2026-02-19T12:43:28.254 INFO:tasks.workunit.client.0.trial109.stdout: "crush-device-class": "", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "crush-failure-domain": "osd", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "crush-num-failure-domains": "0", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "crush-osds-per-failure-domain": "0", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "crush-root": "default", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "k": "2", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "m": "1", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "plugin": "isa", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "technique": "reed_sol_van" 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "removed_snaps_queue": [], 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "new_removed_snaps": [], 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "new_purged_snaps": [], 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "crush_node_flags": {}, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "device_class_flags": {}, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode": { 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_enabled": false, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_bucket_count": 0, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "degraded_stretch_mode": 0, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "recovering_stretch_mode": 0, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "stretch_mode_bucket": 0 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "osd_metadata": [ 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6804/3155133636,v1:127.0.0.1:6805/3155133636]", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:43:28.255 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:41:34.888310Z", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6802/3155133636,v1:127.0.0.1:6803/3155133636]", 2026-02-19T12:43:28.256 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/3155133636,v1:127.0.0.1:6809/3155133636]", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/3155133636,v1:127.0.0.1:6807/3155133636]", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/95910277,v1:127.0.0.1:6813/95910277]", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:43:28.257 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:41:37.740309Z", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/95910277,v1:127.0.0.1:6811/95910277]", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/95910277,v1:127.0.0.1:6817/95910277]", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/95910277,v1:127.0.0.1:6815/95910277]", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:43:28.258 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "arch": "x86_64", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "back_addr": "[v2:127.0.0.1:6812/4070559616,v1:127.0.0.1:6813/4070559616]", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "back_iface": "", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs": "1", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_db": "0", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluefs_single_shared_device": "1", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_allocator": "hybrid", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T12:43:28.259 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "bluestore_write_mode": "classic", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_release": "tentacle", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_short": "20.2.0-720-g2fc421c8", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "ceph_version_when_created": "ceph version 20.2.0-720-g2fc421c8 (2fc421c83f0b86ea21b9e4289cad0f7957e09eb1) tentacle (stable - None)", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "created_at": "2026-02-19T12:41:40.608080Z", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "default_device_class": "ssd", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD6E68", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "devices": "nvme0n1", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "distro": "ubuntu", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "distro_version": "22.04", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "front_addr": "[v2:127.0.0.1:6810/4070559616,v1:127.0.0.1:6811/4070559616]", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "front_iface": "", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4070559616,v1:127.0.0.1:6817/4070559616]", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4070559616,v1:127.0.0.1:6815/4070559616]", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "hostname": "trial109", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "journal_rotational": "0", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "mem_swap_kb": "8388604", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "mem_total_kb": "130961692", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_node": "0", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "objectstore_numa_nodes": "0", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "os": "Linux", 2026-02-19T12:43:28.260 INFO:tasks.workunit.client.0.trial109.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "osd_objectstore": "bluestore", 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "osdspec_affinity": "", 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "rotational": "0" 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_clean_epochs": { 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "min_last_epoch_clean": 24, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "last_epoch_clean": { 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "per_pool": [ 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "floor": 24 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "osd_epochs": [ 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 46 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 50 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_first_committed": 1, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "osdmap_last_committed": 50, 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "crushmap": { 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "devices": [ 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.261 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.0", 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.1", 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd.2", 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "class": "ssd" 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "types": [ 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 0, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "name": "osd" 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "name": "host" 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 2, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "name": "chassis" 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 3, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "name": "rack" 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.262 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 4, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "row" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 5, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pdu" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 6, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "pod" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 7, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "room" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 8, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "datacenter" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 9, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "zone" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 10, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "region" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "name": "root" 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.263 INFO:tasks.workunit.client.0.trial109.stdout: "buckets": [ 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "id": -1, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "id": -2, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "name": "default~ssd", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 11, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "root", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.264 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "id": -3, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109", 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "id": -4, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "name": "trial109~ssd", 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "type_id": 1, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "type_name": "host", 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 19206, 2026-02-19T12:43:28.265 INFO:tasks.workunit.client.0.trial109.stdout: "alg": "straw2", 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "hash": "rjenkins1", 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "items": [ 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "id": 0, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 0 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "id": 1, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 1 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "id": 2, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "weight": 6402, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "pos": 2 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "rules": [ 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 0, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "replicated_rule", 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "type": 1, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.266 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_firstn", 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "rule_id": 1, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "rule_name": "test", 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "type": 3, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "steps": [ 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "op": "set_chooseleaf_tries", 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "num": 5 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "op": "set_choose_tries", 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "num": 100 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "op": "take", 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "item": -1, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "item_name": "default" 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "op": "choose_indep", 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "num": 0, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: "type": "osd" 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.267 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stderr:report 850068587 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "op": "emit" 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: ] 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "tunables": { 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_tries": 0, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "choose_local_fallback_tries": 0, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "choose_total_tries": 50, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_descend_once": 1, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_vary_r": 1, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "chooseleaf_stable": 1, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "msr_descents": 100, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "msr_collision_tries": 100, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "straw_calc_version": 1, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "allowed_bucket_algs": 54, 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "profile": "jewel", 2026-02-19T12:43:28.268 INFO:tasks.workunit.client.0.trial109.stdout: "optimal_tunables": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "legacy_tunables": 0, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "minimum_required_version": "jewel", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables2": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "has_v2_rules": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables3": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "has_v3_rules": 0, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "has_v4_buckets": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "require_feature_tunables5": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "has_v5_rules": 0, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "has_msr_rules": 0 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "choose_args": {} 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "fsmap": { 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "btime": "2026-02-19T12:41:33:817760+0000", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "default_fscid": -1, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "compat": { 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "compat": {}, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "ro_compat": {}, 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "incompat": { 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_1": "base v0.20", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_2": "client writeable ranges", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_4": "dir inode in separate object", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_8": "no anchor table", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_9": "file layout v2", 2026-02-19T12:43:28.269 INFO:tasks.workunit.client.0.trial109.stdout: "feature_10": "snaprealm v2", 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "feature_11": "minor log segments", 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "feature_flags": { 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "enable_multiple": true, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "ever_enabled_multiple": true 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "standbys": [], 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "filesystems": [] 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_first_committed": 1, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "mdsmap_last_committed": 1, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "auth": { 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 5, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_secrets": 3 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_active": 1, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_unknown": 0, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_osd": 3, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "pool_sum": { 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 52200, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 101, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 1, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 303, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:43:28.270 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 101, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 101, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:43:28.271 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 18, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 18, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "up": 3, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 3, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 0 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum": { 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 85060, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2260, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 29, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 82722, 2026-02-19T12:43:28.272 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314487740, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322035445760, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2314240, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 1595638, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 30299, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 84707749 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "osd_sum_by_class": { 2026-02-19T12:43:28.273 INFO:tasks.workunit.client.0.trial109.stdout: "ssd": { 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "up_from": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "num_pgs": 3, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "num_osds": 3, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_osds": 3, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "kb": 314572800, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used": 85060, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_data": 2260, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_omap": 29, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "kb_used_meta": 82722, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "kb_avail": 314487740, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "statfs": { 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "total": 322122547200, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "available": 322035445760, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 2314240, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 1595638, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 30299, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 84707749 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "hb_peers": [], 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "snap_trim_queue_len": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "num_snap_trimming": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "num_shards_repaired": 0, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "op_queue_age_hist": { 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "histogram": [], 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "upper_bound": 1 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.274 INFO:tasks.workunit.client.0.trial109.stdout: "perf_stat": { 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ms": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ms": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "commit_latency_ns": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "apply_latency_ns": 0 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "alerts": [], 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "network_ping_times": [] 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "pool_stats": [ 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": 1, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg": 1, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "stat_sum": { 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes": 52200, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects": 101, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_clones": 1, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_object_copies": 303, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_missing": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_degraded": 101, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_misplaced": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_unfound": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_dirty": 101, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_whiteouts": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_read": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_read_kb": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_write": 101, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_write_kb": 101, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_scrub_errors": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T12:43:28.275 INFO:tasks.workunit.client.0.trial109.stdout: "num_deep_scrub_errors": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_recovered": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_recovered": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_keys_recovered": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_omap": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_kb": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_kb": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_promote": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_high": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_flush_mode_low": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_some": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_evict_mode_full": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_pinned": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_legacy_snapsets": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_large_omap_objects": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_manifest": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_bytes": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_omap_keys": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "num_objects_repaired": 0 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "store_stats": { 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "total": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "available": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "internally_reserved": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "allocated": 1241088, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "data_stored": 1241088, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_allocated": 0, 2026-02-19T12:43:28.276 INFO:tasks.workunit.client.0.trial109.stdout: "data_compressed_original": 0, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "omap_allocated": 0, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "internal_metadata": 0 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "log_size": 18, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "ondisk_log_size": 18, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "up": 3, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "acting": 3, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "num_store_stats": 3 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "osd_stats": [ 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 193273528329 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 38654705680 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "seq": 210453397513 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_state": [ 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "state": "active+undersized+degraded", 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "num": 1 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "pool_pg_unavailable_map": [ 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "poolid": "1", 2026-02-19T12:43:28.277 INFO:tasks.workunit.client.0.trial109.stdout: "pgs": [] 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_pg_by_osd": [ 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2147483647, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 2, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 0, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 1, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 1, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "osd": 1, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_primary_pg": 0, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_acting_pg": 0, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "num_up_not_acting_pg": 0 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": [ 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: { 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "pool": 1, 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: "purged_snaps": {} 2026-02-19T12:43:28.278 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: ], 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "servicemap": { 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "epoch": 3, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "modified": "2026-02-19T12:42:40.530659+0000", 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "services": { 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "osd": { 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "daemons": { 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "summary": "", 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "0": { 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "2": { 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "start_epoch": 0, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "start_stamp": "0.000000", 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "gid": 0, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "metadata": {}, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "task_status": {} 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: }, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_first_committed": 1, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "mgrstat_last_committed": 57, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "logm_first_committed": 1, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "logm_last_committed": 305, 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "paxos": { 2026-02-19T12:43:28.279 INFO:tasks.workunit.client.0.trial109.stdout: "first_committed": 1, 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stdout: "last_committed": 421, 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stdout: "last_pn": 0, 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stdout: "accepted_pn": 0 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stdout: } 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery 2026-02-19T12:43:28.280 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:28.467 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:28.467 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T12:42:55.837317+0000 42'102 50:140 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:46:38.062179+0000 0 0 2026-02-19T12:43:28.467 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:28.467 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:28.467 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:28.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:43:28.477 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-19T12:43:28.477 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T12:43:28.477 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T12:43:28.477 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:43:28.477 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:43:28.478 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:43:28.478 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.0.asok 2026-02-19T12:43:28.478 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T12:43:28.478 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T12:43:28.534 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:43:28.540 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-19T12:43:28.541 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-19T12:43:28.541 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T12:43:28.541 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T12:43:28.541 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:43:28.541 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:43:28.542 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:43:28.542 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.2.asok 2026-02-19T12:43:28.542 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T12:43:28.542 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T12:43:28.598 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:43:28.604 INFO:tasks.workunit.client.0.trial109.stdout:revive divergent 1 2026-02-19T12:43:28.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-19T12:43:28.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:28.824 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:28.824 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T12:42:55.837317+0000 42'102 50:140 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:46:38.062179+0000 0 0 2026-02-19T12:43:28.824 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:28.825 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:28.825 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:28.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-19T12:43:29.164 INFO:tasks.workunit.client.0.trial109.stderr:noup is set 2026-02-19T12:43:29.180 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-19T12:43:29.180 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:43:29.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:43:29.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:43:29.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:43:29.184 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:43:29.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:43:29.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:43:29.185 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:43:29.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:43:29.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:43:29.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:43:29.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:43:29.199 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:29.193+0000 7fec7d5f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:43:29.200 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:29.193+0000 7fec7d5f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:43:29.201 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:29.193+0000 7fec7d5f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:43:29.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T12:43:29.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-19T12:43:29.555 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:29.549+0000 7fec7d5f0a40 -1 Falling back to public interface 2026-02-19T12:43:30.190 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:30.185+0000 7fec7d5f0a40 -1 osd.1 28 log_to_monitors true 2026-02-19T12:43:34.392 INFO:tasks.workunit.client.0.trial109.stdout:delay recovery divergent 2026-02-19T12:43:34.393 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-19T12:43:34.393 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:34.589 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:34.589 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T12:42:55.837317+0000 42'102 52:144 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:46:38.062179+0000 0 0 2026-02-19T12:43:34.589 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:34.589 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:34.590 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:34.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-19T12:43:34.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T12:43:34.601 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T12:43:34.601 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:43:34.601 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:43:34.601 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:43:34.602 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16056/ceph-osd.1.asok 2026-02-19T12:43:34.602 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T12:43:34.602 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16056/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T12:43:34.660 INFO:tasks.workunit.client.0.trial109.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T12:43:34.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-19T12:43:34.995 INFO:tasks.workunit.client.0.trial109.stderr:noup is unset 2026-02-19T12:43:35.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-19T12:43:35.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:43:35.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:43:35.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:43:35.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:43:35.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:43:35.008 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:43:35.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:43:35.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:43:35.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:43:35.229 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 45 up_thru 49 down_at 44 last_clean_interval [35,42) [v2:127.0.0.1:6802/3155133636,v1:127.0.0.1:6803/3155133636] [v2:127.0.0.1:6804/3155133636,v1:127.0.0.1:6805/3155133636] exists,up 94e97762-78b5-4e59-a050-ab5918b006f1 2026-02-19T12:43:35.230 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:43:35.230 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:43:35.230 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:43:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-19T12:43:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:43:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:43:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:43:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:43:35.231 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:43:35.231 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:43:35.232 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:43:35.232 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:43:35.232 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:43:35.440 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1563026347,v1:127.0.0.1:6819/1563026347] [v2:127.0.0.1:6820/1563026347,v1:127.0.0.1:6821/1563026347] exists,up fb219d22-14c4-4a8d-9f7b-140fd863c482 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:43:35.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:43:35.443 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:43:35.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:43:35.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:43:35.654 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 49 up_thru 0 down_at 48 last_clean_interval [38,42) [v2:127.0.0.1:6810/4070559616,v1:127.0.0.1:6811/4070559616] [v2:127.0.0.1:6812/4070559616,v1:127.0.0.1:6813/4070559616] exists,up 0becc3c7-672b-4972-8a2b-4ecf0a909752 2026-02-19T12:43:35.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:43:35.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:43:35.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:43:35.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:35.860 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:35.861 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T12:42:55.837317+0000 42'102 53:146 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:46:38.062179+0000 0 0 2026-02-19T12:43:35.861 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:35.861 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:35.861 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:35.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-19T12:43:35.870 INFO:tasks.workunit.client.0.trial109.stdout:wait for peering 2026-02-19T12:43:35.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:36.087 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:36.087 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T12:42:55.837317+0000 42'102 53:146 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:46:38.062179+0000 0 0 2026-02-19T12:43:36.087 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:36.087 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:36.088 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:36.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.g9oZb0g2PE 2026-02-19T12:43:36.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.g9oZb0g2PE 2026-02-19T12:43:36.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-19T12:43:36.129 INFO:tasks.workunit.client.0.trial109.stdout:killing divergent 1 2026-02-19T12:43:36.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:36.338 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:36.338 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T12:42:55.837317+0000 42'102 53:146 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:46:38.062179+0000 0 0 2026-02-19T12:43:36.338 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:36.338 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:36.338 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:36.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T12:43:36.347 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:43:36.347 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:43:36.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:43:36.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:43:36.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:43:36.455 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:43:36.455 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-19T12:43:36.455 INFO:tasks.workunit.client.0.trial109.stdout:reviving divergent 1 2026-02-19T12:43:36.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:36.649 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:36.649 INFO:tasks.workunit.client.0.trial109.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 peering 2026-02-19T12:43:34.995643+0000 28'104 56:127 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 no scrub is scheduled 0 0 2026-02-19T12:43:36.649 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:36.649 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:36.649 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-19T12:43:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T12:43:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:43:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:43:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:43:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T12:43:36.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:43:36.661 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:43:36.662 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:43:36.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T12:43:36.663 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:43:36.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:43:36.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f7c03ea7-0879-45b6-bbe6-eab8c305991d --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16056/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:43:36.664 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T12:43:36.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:43:36.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:43:36.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:43:36.665 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:43:36.686 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:36.684+0000 7ff578fe8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:43:36.688 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:36.684+0000 7ff578fe8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:43:36.689 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:36.684+0000 7ff578fe8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:43:36.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:43:36.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:43:36.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:43:36.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:43:36.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:43:36.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:43:36.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:43:36.883 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:43:36.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:43:36.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:43:37.023 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:37.020+0000 7ff578fe8a40 -1 Falling back to public interface 2026-02-19T12:43:37.090 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/1563026347,v1:127.0.0.1:6819/1563026347] [v2:127.0.0.1:6820/1563026347,v1:127.0.0.1:6821/1563026347] exists,up fb219d22-14c4-4a8d-9f7b-140fd863c482 2026-02-19T12:43:37.091 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:43:37.091 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:43:37.091 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:43:37.091 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-19T12:43:37.643 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:43:37.640+0000 7ff578fe8a40 -1 osd.1 56 log_to_monitors true 2026-02-19T12:43:57.092 INFO:tasks.workunit.client.0.trial109.stdout:allowing recovery 2026-02-19T12:43:57.093 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-19T12:43:57.093 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:57.287 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:57.288 INFO:tasks.workunit.client.0.trial109.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-19T12:43:38.040340+0000 56'103 60:158 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:22:43.173413+0000 0 0 2026-02-19T12:43:57.288 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:57.288 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:57.288 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:57.296 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-19T12:43:57.296 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T12:43:57.384 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:43:57.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-19T12:43:57.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T12:43:57.473 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:43:57.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-19T12:43:57.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T12:43:57.562 INFO:tasks.workunit.client.0.trial109.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T12:43:57.569 INFO:tasks.workunit.client.0.trial109.stdout:reading divergent objects 2026-02-19T12:43:57.569 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-19T12:43:57.569 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T12:43:57.767 INFO:tasks.workunit.client.0.trial109.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T12:43:57.767 INFO:tasks.workunit.client.0.trial109.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-19T12:43:38.040340+0000 56'103 60:158 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T12:41:45.366295+0000 0'0 2026-02-19T12:41:45.366295+0000 0 0 periodic scrub scheduled @ 2026-02-20T19:22:43.173413+0000 0 0 2026-02-19T12:43:57.767 INFO:tasks.workunit.client.0.trial109.stdout: 2026-02-19T12:43:57.767 INFO:tasks.workunit.client.0.trial109.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T12:43:57.768 INFO:tasks.workunit.client.0.trial109.stderr:dumped pgs 2026-02-19T12:43:57.776 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-19T12:43:57.777 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-19T12:43:57.778 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:43:57.778 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T12:43:57.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:43:57.800 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T12:43:57.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:43:57.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T12:43:57.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T12:43:57.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T12:43:57.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-19T12:43:57.883 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-19T12:43:57.885 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:43:57.888 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 28'103 (27'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-19T12:41:57.571578+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:43:57.888 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 20 _merge_object_divergent_entries: keeping 28'103 (27'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-19T12:41:57.571578+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 27'99 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 28'104 (27'99) modify 1:7a80c0d5:::existing_99:head by client.4559.0:1 2026-02-19T12:42:02.458330+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 20 _merge_object_divergent_entries: keeping 28'104 (27'99) modify 1:7a80c0d5:::existing_99:head by client.4559.0:1 2026-02-19T12:42:02.458330+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 27'99 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 28'104 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 28'104 (27'99) modify 1:7a80c0d5:::existing_99:head by client.4559.0:1 2026-02-19T12:42:02.458330+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T12:43:57.889 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4550.0:1 2026-02-19T12:42:01.386597+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,27'102 (27'101) modify 1:c156033e:::existing_100:head by client.4556.0:1 2026-02-19T12:42:02.384420+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 20 _merge_object_divergent_entries: keeping 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4550.0:1 2026-02-19T12:42:01.386597+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 20 _merge_object_divergent_entries: keeping 27'102 (27'101) modify 1:c156033e:::existing_100:head by client.4556.0:1 2026-02-19T12:42:02.384420+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 27'100 first_divergent_update: 27'101 last_divergent_update: 27'102 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 28'104 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 27'102 (27'101) modify 1:c156033e:::existing_100:head by client.4556.0:1 2026-02-19T12:42:02.384420+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stdout:td/divergent-priors/osd.1.log:2026-02-19T12:43:35.472+0000 7fec5ad6d640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-19T12:43:57.891 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-19T12:43:57.892 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T12:43:57.895 INFO:tasks.workunit.client.0.trial109.stdout:success 2026-02-19T12:43:57.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-19T12:43:57.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-19T12:43:57.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T12:43:57.896 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T12:43:58.157 INFO:tasks.workunit.client.0.trial109.stderr:pool 'test' does not exist 2026-02-19T12:43:58.166 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-19T12:43:58.167 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:43:58.167 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:43:58.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:43:58.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:43:58.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:03.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:03.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T12:44:03.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:44:03.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:44:03.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:44:03.485 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:03.485 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:03.485 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:03.485 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:03.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:03.492 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:03.492 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:03.493 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:03.493 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:03.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:03.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:03.495 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:03.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:03.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:03.497 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:03.497 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:03.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:03.499 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:44:03.499 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:44:03.522 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:03.522 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.522 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:44:03.522 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:44:03.523 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:03.523 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/divergent-priors 0 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:03.524 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:03.527 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:03.527 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:03.528 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:03.528 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:03.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:03.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:03.530 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:03.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:03.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:03.532 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:03.532 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:03.533 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:03.534 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T12:44:03.534 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T12:44:03.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:03.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16056 2026-02-19T12:44:03.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16056 2026-02-19T12:44:03.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:03.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:03.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-19T12:44:03.538 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T12:44:03.538 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T12:44:03.589 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-19T12:44:03.589 DEBUG:teuthology.orchestra.run.trial109:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=624b9a7bcb2064ce17206482df6a1da007ff7675 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-19T12:44:03.642 INFO:tasks.workunit.client.0.trial109.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T12:44:03.645 INFO:tasks.workunit.client.0.trial109.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T12:44:03.645 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/ec-error-rollforward 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-19T12:44:03.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-19T12:44:03.647 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-19T12:44:03.647 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-19T12:44:03.647 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-19T12:44:03.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none ' 2026-02-19T12:44:03.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:03.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-19T12:44:03.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-19T12:44:03.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-19T12:44:03.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-19T12:44:03.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-19T12:44:03.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-19T12:44:03.649 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-19T12:44:03.649 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T12:44:03.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-19T12:44:03.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:03.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:03.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:03.652 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:03.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:03.653 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:03.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:03.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:03.654 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:03.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:03.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:03.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:03.656 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:03.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:03.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:44:03.658 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-19T12:44:03.660 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:03.660 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.660 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:03.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72142 2026-02-19T12:44:03.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:03.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:03.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-19T12:44:03.663 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:44:03.663 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.663 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:03.663 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.72142 2026-02-19T12:44:03.664 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-19T12:44:03.666 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:44:03.667 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:44:03.667 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:44:03.667 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-19T12:44:03.667 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-19T12:44:03.688 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:44:03.688 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:03.688 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:03.688 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:03.688 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.688 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:03.688 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:03.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:44:03.715 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:44:03.716 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:44:03.716 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:44:03.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:44:03.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:44:03.717 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:44:03.718 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:44:03.718 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:44:03.718 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:44:03.718 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:44:03.718 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.718 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:03.719 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72142/ceph-mon.a.asok 2026-02-19T12:44:03.719 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:44:03.719 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72142/ceph-mon.a.asok config get fsid 2026-02-19T12:44:03.772 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:44:03.773 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:44:03.773 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:44:03.773 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:44:03.773 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:44:03.774 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:44:03.774 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:44:03.774 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:44:03.774 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:44:03.774 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.774 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:03.775 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.72142/ceph-mon.a.asok 2026-02-19T12:44:03.775 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:44:03.775 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.72142/ceph-mon.a.asok config get mon_host 2026-02-19T12:44:03.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-19T12:44:03.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-19T12:44:03.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:44:03.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:44:03.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:44:03.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-19T12:44:03.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:44:03.935 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:44:03.936 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:03.936 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:03.936 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:03.936 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.936 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:03.936 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:03.937 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:44:03.937 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:44:03.957 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-19T12:44:03.957 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-19T12:44:03.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:03.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:03.960 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-19T12:44:03.961 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:03.961 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=466c090e-2bf1-418e-8737-39cdb1ee8c3c 2026-02-19T12:44:03.961 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 466c090e-2bf1-418e-8737-39cdb1ee8c3c' 2026-02-19T12:44:03.962 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 466c090e-2bf1-418e-8737-39cdb1ee8c3c 2026-02-19T12:44:03.962 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:03.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCTBZdpuMLDORAAQ4pwt+yfsmKJ+5C6LzgARw== 2026-02-19T12:44:03.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCTBZdpuMLDORAAQ4pwt+yfsmKJ+5C6LzgARw=="}' 2026-02-19T12:44:03.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 466c090e-2bf1-418e-8737-39cdb1ee8c3c -i td/ec-error-rollforward/0/new.json 2026-02-19T12:44:04.087 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:04.095 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-19T12:44:04.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCTBZdpuMLDORAAQ4pwt+yfsmKJ+5C6LzgARw== --osd-uuid 466c090e-2bf1-418e-8737-39cdb1ee8c3c 2026-02-19T12:44:04.111 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:04.108+0000 7f9a492a9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:04.113 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:04.108+0000 7f9a492a9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:04.113 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:04.112+0000 7f9a492a9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:04.114 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:04.112+0000 7f9a492a9a40 -1 bdev(0x564e86226c00 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:04.114 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:04.112+0000 7f9a492a9a40 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-19T12:44:04.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-19T12:44:04.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:04.845 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:44:04.846 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:44:04.846 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:05.129 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:44:05.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:44:05.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:05.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:05.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:05.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:05.145 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:05.144+0000 7fb3f5d96a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:05.147 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:05.144+0000 7fb3f5d96a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:05.148 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:05.144+0000 7fb3f5d96a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:05.342 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:44:05.342 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:05.342 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:44:05.343 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:05.343 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:05.343 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:05.343 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:05.344 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:05.344 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:05.344 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:05.543 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:05.540+0000 7fb3f5d96a40 -1 Falling back to public interface 2026-02-19T12:44:05.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:06.120 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:06.116+0000 7fb3f5d96a40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:44:06.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:06.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:06.554 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:06.554 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:06.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:06.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:06.763 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4203643551,v1:127.0.0.1:6803/4203643551] [v2:127.0.0.1:6804/4203643551,v1:127.0.0.1:6805/4203643551] exists,up 466c090e-2bf1-418e-8737-39cdb1ee8c3c 2026-02-19T12:44:06.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:06.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:06.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:06.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-19T12:44:06.767 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-19T12:44:06.768 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:06.769 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:06.770 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1548485f-feb0-476e-ae00-5ebbceedb8cc 2026-02-19T12:44:06.771 INFO:tasks.workunit.client.0.trial109.stdout:add osd1 1548485f-feb0-476e-ae00-5ebbceedb8cc 2026-02-19T12:44:06.771 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 1548485f-feb0-476e-ae00-5ebbceedb8cc' 2026-02-19T12:44:06.771 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:06.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCWBZdpsZRVLhAAph1iz7EYYCyKh4laS9V1iw== 2026-02-19T12:44:06.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCWBZdpsZRVLhAAph1iz7EYYCyKh4laS9V1iw=="}' 2026-02-19T12:44:06.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1548485f-feb0-476e-ae00-5ebbceedb8cc -i td/ec-error-rollforward/1/new.json 2026-02-19T12:44:06.997 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:07.008 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-19T12:44:07.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCWBZdpsZRVLhAAph1iz7EYYCyKh4laS9V1iw== --osd-uuid 1548485f-feb0-476e-ae00-5ebbceedb8cc 2026-02-19T12:44:07.024 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.020+0000 7f625d357a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:07.026 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.024+0000 7f625d357a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:07.027 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.024+0000 7f625d357a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:07.027 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.024+0000 7f625d357a40 -1 bdev(0x5614b52f2c00 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:07.027 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.024+0000 7f625d357a40 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-19T12:44:07.682 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-19T12:44:07.682 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:07.682 INFO:tasks.workunit.client.0.trial109.stdout:adding osd1 key to auth repository 2026-02-19T12:44:07.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T12:44:07.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:07.965 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:44:07.966 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T12:44:07.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:07.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:07.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:07.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:07.988 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.984+0000 7f9568ac6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:07.990 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.988+0000 7f9568ac6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:07.991 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:07.988+0000 7f9568ac6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:08.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T12:44:08.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:08.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:44:08.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:08.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:08.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:08.176 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:08.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:08.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:08.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:44:08.319 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:08.316+0000 7f9568ac6a40 -1 Falling back to public interface 2026-02-19T12:44:08.388 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:08.943 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:08.940+0000 7f9568ac6a40 -1 osd.1 0 log_to_monitors true 2026-02-19T12:44:09.389 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:09.389 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:09.389 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:09.390 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:09.390 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:09.390 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:44:09.599 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2566316250,v1:127.0.0.1:6811/2566316250] [v2:127.0.0.1:6812/2566316250,v1:127.0.0.1:6813/2566316250] exists,up 1548485f-feb0-476e-ae00-5ebbceedb8cc 2026-02-19T12:44:09.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:09.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:09.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:09.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-19T12:44:09.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:09.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:09.604 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-19T12:44:09.605 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:09.606 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:09.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:09.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:09.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-19T12:44:09.609 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:09.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=84b067a3-3211-4168-82df-d121e803dd75 2026-02-19T12:44:09.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 84b067a3-3211-4168-82df-d121e803dd75' 2026-02-19T12:44:09.609 INFO:tasks.workunit.client.0.trial109.stdout:add osd2 84b067a3-3211-4168-82df-d121e803dd75 2026-02-19T12:44:09.610 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:09.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCZBZdp+9iXJBAA9D6cS8u7gco3EnE87Hxaaw== 2026-02-19T12:44:09.616 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCZBZdp+9iXJBAA9D6cS8u7gco3EnE87Hxaaw=="}' 2026-02-19T12:44:09.616 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 84b067a3-3211-4168-82df-d121e803dd75 -i td/ec-error-rollforward/2/new.json 2026-02-19T12:44:09.831 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:09.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-19T12:44:09.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCZBZdp+9iXJBAA9D6cS8u7gco3EnE87Hxaaw== --osd-uuid 84b067a3-3211-4168-82df-d121e803dd75 2026-02-19T12:44:09.857 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:09.852+0000 7fa7794cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:09.858 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:09.856+0000 7fa7794cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:09.859 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:09.856+0000 7fa7794cba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:09.860 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:09.856+0000 7fa7794cba40 -1 bdev(0x55921f620c00 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:09.860 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:09.856+0000 7fa7794cba40 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-19T12:44:10.516 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-19T12:44:10.516 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:10.517 INFO:tasks.workunit.client.0.trial109.stdout:adding osd2 key to auth repository 2026-02-19T12:44:10.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T12:44:10.517 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:10.803 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:44:10.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T12:44:10.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:10.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:10.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:10.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:10.825 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:10.820+0000 7fc65c099a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:10.827 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:10.824+0000 7fc65c099a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:10.828 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:10.824+0000 7fc65c099a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:11.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T12:44:11.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:11.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:44:11.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:11.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:11.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:11.017 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:11.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:11.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:11.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:44:11.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:11.227 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:11.224+0000 7fc65c099a40 -1 Falling back to public interface 2026-02-19T12:44:11.888 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:11.884+0000 7fc65c099a40 -1 osd.2 0 log_to_monitors true 2026-02-19T12:44:12.228 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:12.228 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:12.228 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:12.229 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:12.229 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:12.229 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:44:12.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:13.441 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:13.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:13.442 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:13.442 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:44:13.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:13.443 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:44:13.646 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3731935494,v1:127.0.0.1:6819/3731935494] [v2:127.0.0.1:6820/3731935494,v1:127.0.0.1:6821/3731935494] exists,up 84b067a3-3211-4168-82df-d121e803dd75 2026-02-19T12:44:13.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:13.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:13.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:13.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-19T12:44:13.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:13.650 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:13.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:13.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-19T12:44:13.653 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:13.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=49a5b9fe-d8cb-451f-8df9-7856aa1da46c 2026-02-19T12:44:13.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 49a5b9fe-d8cb-451f-8df9-7856aa1da46c' 2026-02-19T12:44:13.654 INFO:tasks.workunit.client.0.trial109.stdout:add osd3 49a5b9fe-d8cb-451f-8df9-7856aa1da46c 2026-02-19T12:44:13.655 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:13.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCdBZdpLTxzJxAAMrQs5nhtKk8sLzR6IvzZtQ== 2026-02-19T12:44:13.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCdBZdpLTxzJxAAMrQs5nhtKk8sLzR6IvzZtQ=="}' 2026-02-19T12:44:13.664 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 49a5b9fe-d8cb-451f-8df9-7856aa1da46c -i td/ec-error-rollforward/3/new.json 2026-02-19T12:44:13.876 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:44:13.885 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-19T12:44:13.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCdBZdpLTxzJxAAMrQs5nhtKk8sLzR6IvzZtQ== --osd-uuid 49a5b9fe-d8cb-451f-8df9-7856aa1da46c 2026-02-19T12:44:13.902 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:13.900+0000 7f3caa7b7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:13.903 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:13.900+0000 7f3caa7b7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:13.904 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:13.900+0000 7f3caa7b7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:13.904 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:13.900+0000 7f3caa7b7a40 -1 bdev(0x55aa7e0a0c00 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:13.905 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:13.900+0000 7f3caa7b7a40 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-19T12:44:14.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-19T12:44:14.552 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:14.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-19T12:44:14.553 INFO:tasks.workunit.client.0.trial109.stdout:adding osd3 key to auth repository 2026-02-19T12:44:14.554 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:14.839 INFO:tasks.workunit.client.0.trial109.stdout:start osd.3 2026-02-19T12:44:14.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-19T12:44:14.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:14.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:14.840 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:14.841 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:14.854 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:14.852+0000 7fa7e181da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:14.856 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:14.852+0000 7fa7e181da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:14.857 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:14.852+0000 7fa7e181da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:15.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-19T12:44:15.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:15.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T12:44:15.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:15.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:15.052 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:15.052 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:15.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:15.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:15.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:44:15.227 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:15.224+0000 7fa7e181da40 -1 Falling back to public interface 2026-02-19T12:44:15.267 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:15.863 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:15.860+0000 7fa7e181da40 -1 osd.3 0 log_to_monitors true 2026-02-19T12:44:16.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:16.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:16.268 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:16.269 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:16.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:16.269 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:44:16.480 INFO:tasks.workunit.client.0.trial109.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/925494411,v1:127.0.0.1:6827/925494411] [v2:127.0.0.1:6828/925494411,v1:127.0.0.1:6829/925494411] exists,up 49a5b9fe-d8cb-451f-8df9-7856aa1da46c 2026-02-19T12:44:16.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:16.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:16.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:16.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-19T12:44:16.710 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-19T12:44:17.072 INFO:tasks.workunit.client.0.trial109.stderr:pool 'ec' already exists 2026-02-19T12:44:17.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-19T12:44:18.950 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-19T12:44:18.950 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 77284 2026-02-19T12:44:18.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=79481 2026-02-19T12:44:18.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-19T12:44:18.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-19T12:44:19.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 79502' 2026-02-19T12:44:19.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-19T12:44:19.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 79503' 2026-02-19T12:44:19.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-19T12:44:19.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 79504' 2026-02-19T12:44:19.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-19T12:44:19.953 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-19T12:44:20.954 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-19T12:44:20.955 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:20.955 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:20.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:20.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:20.955 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:21.066 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:21.066 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 79481 79502 79503 79504 2026-02-19T12:44:21.066 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:21.068 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:44:21.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-19T12:44:21.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:44:21.070 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:44:21.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:21.070 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-19T12:44:21.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:44:21.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:44:21.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:44:21.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:44:21.093 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.088+0000 7f1276209a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.094 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.092+0000 7f1276209a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.095 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.092+0000 7f1276209a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:21.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:21.486 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.484+0000 7f1276209a40 -1 Falling back to public interface 2026-02-19T12:44:21.494 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4203643551,v1:127.0.0.1:6803/4203643551] [v2:127.0.0.1:6804/4203643551,v1:127.0.0.1:6805/4203643551] exists,up 466c090e-2bf1-418e-8737-39cdb1ee8c3c 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:44:21.495 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-19T12:44:21.496 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:44:21.497 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:44:21.497 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:21.497 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-19T12:44:21.497 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:44:21.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:44:21.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:44:21.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:44:21.517 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.516+0000 7f41ed7b8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.519 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.516+0000 7f41ed7b8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.520 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.516+0000 7f41ed7b8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.711 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:44:21.711 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:21.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:44:21.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:21.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:21.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:21.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:21.712 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:21.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:21.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:44:21.927 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 22 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2566316250,v1:127.0.0.1:6811/2566316250] [v2:127.0.0.1:6812/2566316250,v1:127.0.0.1:6813/2566316250] exists,up 1548485f-feb0-476e-ae00-5ebbceedb8cc 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:44:21.928 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:44:21.929 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-19T12:44:21.930 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:44:21.930 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:44:21.930 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:21.931 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-19T12:44:21.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:44:21.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:44:21.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:44:21.932 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:44:21.950 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.948+0000 7f2ac2bafa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.951 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.948+0000 7f2ac2bafa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.952 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.948+0000 7f2ac2bafa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:21.994 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:21.992+0000 7f41ed7b8a40 -1 Falling back to public interface 2026-02-19T12:44:22.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:44:22.141 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:22.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:44:22.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:22.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:22.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:22.142 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:22.143 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:22.143 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:22.143 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:44:22.352 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3731935494,v1:127.0.0.1:6819/3731935494] [v2:127.0.0.1:6820/3731935494,v1:127.0.0.1:6821/3731935494] exists,up 84b067a3-3211-4168-82df-d121e803dd75 2026-02-19T12:44:22.355 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-19T12:44:22.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:22.357 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:44:22.358 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:44:22.359 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-19T12:44:22.359 INFO:tasks.workunit.client.0.trial109.stdout:start osd.3 2026-02-19T12:44:22.360 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T12:44:22.360 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=2a239065-1fc3-4b73-b71b-250663e92a8f --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.72142/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:22.360 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-19T12:44:22.360 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T12:44:22.360 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:44:22.361 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:44:22.361 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:44:22.379 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:22.376+0000 7fd9e9bd6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:22.380 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:22.376+0000 7fd9e9bd6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:22.381 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:22.380+0000 7fd9e9bd6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:22.419 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:22.416+0000 7f2ac2bafa40 -1 Falling back to public interface 2026-02-19T12:44:22.444 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:22.440+0000 7f1276209a40 -1 osd.0 24 log_to_monitors true 2026-02-19T12:44:22.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T12:44:22.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:22.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T12:44:22.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:22.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:22.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:22.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:22.571 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:22.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:22.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:44:22.781 INFO:tasks.workunit.client.0.trial109.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/925494411,v1:127.0.0.1:6827/925494411] [v2:127.0.0.1:6828/925494411,v1:127.0.0.1:6829/925494411] exists,up 49a5b9fe-d8cb-451f-8df9-7856aa1da46c 2026-02-19T12:44:22.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:22.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:22.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:22.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:44:22.784 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:44:22.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:44:22.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:44:22.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:44:22.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:44:22.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:44:22.878 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:44:22.879 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:22.876+0000 7fd9e9bd6a40 -1 Falling back to public interface 2026-02-19T12:44:22.973 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:22.968+0000 7f41ed7b8a40 -1 osd.1 24 log_to_monitors true 2026-02-19T12:44:23.086 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:44:23.086 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:44:23.086 INFO:tasks.workunit.client.0.trial109.stderr:2 2026-02-19T12:44:23.086 INFO:tasks.workunit.client.0.trial109.stderr:3' 2026-02-19T12:44:23.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:44:23.087 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:44:23.087 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:44:23.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116995 2026-02-19T12:44:23.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116995 2026-02-19T12:44:23.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-115964116995' 2026-02-19T12:44:23.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:44:23.165 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:44:23.219 INFO:tasks.workunit.client.0.trial109.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-19T12:44:23.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T12:44:23.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T12:44:23.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-19T12:44:23.220 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:44:23.221 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:44:23.376 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:23.372+0000 7f2ac2bafa40 -1 osd.2 23 log_to_monitors true 2026-02-19T12:44:23.683 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:23.680+0000 7fd9e9bd6a40 -1 osd.3 24 log_to_monitors true 2026-02-19T12:44:28.306 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-19T12:44:28.306 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-19T12:44:28.306 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-115964116995 2-150323855363' 2026-02-19T12:44:28.306 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:44:28.307 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-19T12:44:28.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-19T12:44:28.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-19T12:44:28.384 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-115964116995 2-150323855363 3-158913789955' 2026-02-19T12:44:28.385 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:44:28.385 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-115964116995 2026-02-19T12:44:28.385 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:44:28.386 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:44:28.386 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-115964116995 2026-02-19T12:44:28.387 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:44:28.388 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=115964116995 2026-02-19T12:44:28.388 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 115964116995 2026-02-19T12:44:28.388 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 115964116995' 2026-02-19T12:44:28.388 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:44:28.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 115964116996 -lt 115964116995 2026-02-19T12:44:28.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:44:28.610 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-19T12:44:28.610 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:44:28.611 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:44:28.612 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-150323855363 2026-02-19T12:44:28.612 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:44:28.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855363 2026-02-19T12:44:28.614 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 150323855363 2026-02-19T12:44:28.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-19T12:44:28.614 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:44:28.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-19T12:44:28.829 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:44:28.829 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-158913789955 2026-02-19T12:44:28.829 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:44:28.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-19T12:44:28.831 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-158913789955 2026-02-19T12:44:28.831 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:44:28.832 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789955 2026-02-19T12:44:28.833 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.3 seq 158913789955 2026-02-19T12:44:28.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 158913789955' 2026-02-19T12:44:28.833 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-19T12:44:29.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-19T12:44:29.055 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:44:29.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:44:29.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:44:29.330 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T12:44:29.331 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:44:29.332 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:44:29.332 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:44:29.332 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:44:29.332 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:44:29.332 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:44:29.332 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:44:29.530 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T12:44:29.531 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:44:29.531 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:44:29.532 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:44:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T12:44:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:44:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:44:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-19T12:44:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-19T12:44:29.804 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:44:29.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-19T12:44:29.805 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:29.805 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:29.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:29.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:29.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:29.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:29.914 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:29.914 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:29.914 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:29.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:29.916 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:29.916 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:29.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:29.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:29.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:29.918 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:29.919 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:29.920 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:44:29.920 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-19T12:44:29.933 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:29.933 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:29.933 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:29.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72142 2026-02-19T12:44:29.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:29.935 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/ec-error-rollforward 0 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:29.936 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:29.937 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:29.938 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:29.939 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:29.939 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:29.940 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:29.940 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:29.940 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:29.941 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:29.941 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:29.942 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:29.942 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:29.943 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:29.944 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T12:44:29.944 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-19T12:44:29.945 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:29.945 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:29.946 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.72142 2026-02-19T12:44:29.946 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.72142 2026-02-19T12:44:29.946 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:29.947 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:29.947 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-19T12:44:29.948 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T12:44:29.948 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T12:44:29.997 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-19T12:44:29.998 DEBUG:teuthology.orchestra.run.trial109:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=624b9a7bcb2064ce17206482df6a1da007ff7675 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-19T12:44:30.050 INFO:tasks.workunit.client.0.trial109.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T12:44:30.054 INFO:tasks.workunit.client.0.trial109.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T12:44:30.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:44:30.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:44:30.054 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/osd-bench 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-19T12:44:30.055 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-19T12:44:30.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-19T12:44:30.056 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-19T12:44:30.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=9ea1352a-2f30-4c8c-98a8-97c0d25b2a81 --auth-supported=none ' 2026-02-19T12:44:30.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-19T12:44:30.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-19T12:44:30.057 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-19T12:44:30.057 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T12:44:30.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-19T12:44:30.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-19T12:44:30.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-19T12:44:30.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-19T12:44:30.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:30.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:30.061 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:30.061 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:30.061 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:30.062 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:30.063 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:30.063 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:30.063 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:30.064 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:30.064 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:30.065 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:30.065 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:30.066 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:30.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:44:30.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-19T12:44:30.068 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:30.069 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:30.069 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:30.069 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.82055 2026-02-19T12:44:30.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:30.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:30.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-19T12:44:30.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:44:30.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:30.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.82055 2026-02-19T12:44:30.073 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-19T12:44:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-19T12:44:30.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:44:30.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:44:30.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:44:30.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-19T12:44:30.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-19T12:44:30.100 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:44:30.100 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:30.100 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:30.100 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:30.100 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:30.101 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:30.101 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.82055/$cluster-$name.asok' 2026-02-19T12:44:30.101 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.82055/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:44:30.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:44:30.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:44:30.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:44:30.131 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:44:30.131 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:44:30.131 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:44:30.131 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:44:30.131 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:44:30.131 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:44:30.132 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:44:30.132 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:30.132 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:30.133 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.82055/ceph-mon.a.asok 2026-02-19T12:44:30.133 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:44:30.133 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.82055/ceph-mon.a.asok config get fsid 2026-02-19T12:44:30.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:44:30.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:30.189 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:30.190 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.82055/ceph-mon.a.asok 2026-02-19T12:44:30.190 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:44:30.190 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.82055/ceph-mon.a.asok config get mon_host 2026-02-19T12:44:30.244 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-19T12:44:30.244 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-19T12:44:30.244 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:44:30.244 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:44:30.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:44:30.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-19T12:44:30.245 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:44:30.355 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:44:30.355 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:30.355 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:30.355 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:30.355 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:30.356 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:30.356 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.82055/$cluster-$name.asok' 2026-02-19T12:44:30.356 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:44:30.356 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.82055/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:44:30.376 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-19T12:44:30.376 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9ea1352a-2f30-4c8c-98a8-97c0d25b2a81 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-19T12:44:30.377 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:30.378 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.82055/$cluster-$name.asok' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.82055/$cluster-$name.asok' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:30.379 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:30.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:30.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-19T12:44:30.380 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:30.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6b90de9e-5841-4b0b-b778-de71d0e5f4a3 2026-02-19T12:44:30.380 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6b90de9e-5841-4b0b-b778-de71d0e5f4a3' 2026-02-19T12:44:30.380 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 6b90de9e-5841-4b0b-b778-de71d0e5f4a3 2026-02-19T12:44:30.381 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:30.387 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCuBZdpA2sAFxAAnHIWn8l4i1QMug6nNNKQjA== 2026-02-19T12:44:30.387 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCuBZdpA2sAFxAAnHIWn8l4i1QMug6nNNKQjA=="}' 2026-02-19T12:44:30.387 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6b90de9e-5841-4b0b-b778-de71d0e5f4a3 -i td/osd-bench/0/new.json 2026-02-19T12:44:30.496 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:30.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-19T12:44:30.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=9ea1352a-2f30-4c8c-98a8-97c0d25b2a81 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.82055/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCuBZdpA2sAFxAAnHIWn8l4i1QMug6nNNKQjA== --osd-uuid 6b90de9e-5841-4b0b-b778-de71d0e5f4a3 2026-02-19T12:44:30.521 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:30.519+0000 7f1470e22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:30.523 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:30.519+0000 7f1470e22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:30.524 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:30.519+0000 7f1470e22a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:30.524 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:30.519+0000 7f1470e22a40 -1 bdev(0x56421e4d4c00 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:30.524 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:30.519+0000 7f1470e22a40 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-19T12:44:31.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-19T12:44:31.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:31.327 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:44:31.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:44:31.328 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:31.620 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:44:31.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:44:31.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=9ea1352a-2f30-4c8c-98a8-97c0d25b2a81 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.82055/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:31.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:31.621 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:31.621 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:31.644 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:31.639+0000 7f6ed9787a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:31.645 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:31.643+0000 7f6ed9787a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:31.647 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:31.643+0000 7f6ed9787a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:31.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:31.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:32.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:32.042 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:32.039+0000 7f6ed9787a40 -1 Falling back to public interface 2026-02-19T12:44:32.615 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:32.611+0000 7f6ed9787a40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:44:33.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:33.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:33.042 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:33.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:33.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:33.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:33.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:34.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:34.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:34.290 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:34.291 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:44:34.291 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:34.291 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:34.500 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/937001646,v1:127.0.0.1:6803/937001646] [v2:127.0.0.1:6804/937001646,v1:127.0.0.1:6805/937001646] exists,up 6b90de9e-5841-4b0b-b778-de71d0e5f4a3 2026-02-19T12:44:34.501 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:34.501 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:34.501 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:34.501 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-19T12:44:34.501 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-19T12:44:34.509 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-19T12:44:34.510 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-19T12:44:34.510 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-19T12:44:34.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-19T12:44:34.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-19T12:44:34.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-19T12:44:34.534 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-19T12:44:34.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-19T12:44:34.535 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-19T12:44:34.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-19T12:44:34.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-19T12:44:34.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-19T12:44:34.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-19T12:44:34.548 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-19T12:44:34.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-19T12:44:34.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-19T12:44:34.549 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-19T12:44:34.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-19T12:44:34.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-19T12:44:34.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-19T12:44:34.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-19T12:44:34.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-19T12:44:34.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-19T12:44:34.622 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-19T12:44:34.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-19T12:44:34.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-19T12:44:34.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-19T12:44:34.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-19T12:44:34.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-19T12:44:34.624 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-19T12:44:34.691 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-19T12:44:34.692 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-19T12:44:34.692 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-19T12:44:34.693 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-19T12:44:34.693 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-19T12:44:34.693 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-19T12:44:34.693 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-19T12:44:34.693 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-19T12:44:34.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-19T12:44:34.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-19T12:44:34.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-19T12:44:34.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-19T12:44:34.694 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-19T12:44:34.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-19T12:44:34.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-19T12:44:34.763 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-19T12:44:34.763 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-19T12:44:34.763 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-19T12:44:36.414 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:44:36.414 INFO:tasks.workunit.client.0.trial109.stdout: "bytes_written": 1073741824, 2026-02-19T12:44:36.414 INFO:tasks.workunit.client.0.trial109.stdout: "blocksize": 4194304, 2026-02-19T12:44:36.414 INFO:tasks.workunit.client.0.trial109.stdout: "elapsed_sec": 0.69575061999999999, 2026-02-19T12:44:36.414 INFO:tasks.workunit.client.0.trial109.stdout: "bytes_per_sec": 1543285472.0273192, 2026-02-19T12:44:36.414 INFO:tasks.workunit.client.0.trial109.stdout: "iops": 367.94792938883762 2026-02-19T12:44:36.414 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:44:36.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-19T12:44:36.491 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:44:36.491 INFO:tasks.workunit.client.0.trial109.stdout: "bytes_written": 10, 2026-02-19T12:44:36.491 INFO:tasks.workunit.client.0.trial109.stdout: "blocksize": 14456, 2026-02-19T12:44:36.491 INFO:tasks.workunit.client.0.trial109.stdout: "elapsed_sec": 0.00033273899999999997, 2026-02-19T12:44:36.491 INFO:tasks.workunit.client.0.trial109.stdout: "bytes_per_sec": 30053.585543023211, 2026-02-19T12:44:36.491 INFO:tasks.workunit.client.0.trial109.stdout: "iops": 2.0789696695505819 2026-02-19T12:44:36.491 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:44:36.500 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-19T12:44:36.567 INFO:tasks.workunit.client.0.trial109.stdout:{ 2026-02-19T12:44:36.567 INFO:tasks.workunit.client.0.trial109.stdout: "bytes_written": 1, 2026-02-19T12:44:36.568 INFO:tasks.workunit.client.0.trial109.stdout: "blocksize": 14456, 2026-02-19T12:44:36.568 INFO:tasks.workunit.client.0.trial109.stdout: "elapsed_sec": 0.000239986, 2026-02-19T12:44:36.568 INFO:tasks.workunit.client.0.trial109.stdout: "bytes_per_sec": 4166.9097364012896, 2026-02-19T12:44:36.568 INFO:tasks.workunit.client.0.trial109.stdout: "iops": 0.28824776815172176 2026-02-19T12:44:36.568 INFO:tasks.workunit.client.0.trial109.stdout:} 2026-02-19T12:44:36.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-19T12:44:36.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-19T12:44:36.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:44:36.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-19T12:44:36.576 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:36.576 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:36.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:36.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:36.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:36.684 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:36.684 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:36.685 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:36.685 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:36.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:36.686 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:36.687 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:36.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:36.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:36.688 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:36.688 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:36.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:36.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:44:36.690 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-19T12:44:36.723 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:36.723 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:36.723 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:36.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.82055 2026-02-19T12:44:36.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:36.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:36.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/osd-bench 0 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:36.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:36.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:36.728 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:36.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:36.729 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:36.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:36.730 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:36.731 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:36.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:36.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:36.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:36.733 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:36.734 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:36.734 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T12:44:36.735 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-19T12:44:36.736 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:36.736 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:36.736 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.82055 2026-02-19T12:44:36.736 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.82055 2026-02-19T12:44:36.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:36.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:36.737 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-19T12:44:36.738 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T12:44:36.739 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T12:44:36.789 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-19T12:44:36.789 DEBUG:teuthology.orchestra.run.trial109:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=624b9a7bcb2064ce17206482df6a1da007ff7675 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-19T12:44:36.842 INFO:tasks.workunit.client.0.trial109.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T12:44:36.847 INFO:tasks.workunit.client.0.trial109.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T12:44:36.847 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:44:36.847 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T12:44:36.847 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/osd-bluefs-volume-ops 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:36.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-19T12:44:36.849 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-19T12:44:36.849 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T12:44:36.850 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:TEST_bluestore2 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:TEST_bluestore_expand' 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:44:36.851 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:44:36.852 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:44:36.852 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:44:36.852 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:44:36.852 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:44:36.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:44:36.854 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:44:36.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:44:36.855 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:44:36.855 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:44:36.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:36.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:44:36.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:44:36.857 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:44:36.858 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:44:36.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:44:36.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T12:44:36.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:44:36.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:36.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:36.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83893 2026-02-19T12:44:36.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:44:36.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:44:36.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-19T12:44:36.864 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:44:36.864 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:36.864 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:36.864 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83893 2026-02-19T12:44:36.866 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:44:36.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T12:44:36.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T12:44:36.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:44:36.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-19T12:44:36.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-19T12:44:36.867 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:36.867 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none ' 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-19T12:44:36.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=0 ' 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-19T12:44:36.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:36.892 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:44:36.892 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:36.893 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:36.893 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:36.893 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:36.893 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:36.893 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:36.893 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:44:36.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:44:36.923 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:44:36.923 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:44:36.923 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:44:36.923 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:44:36.923 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83893/ceph-mon.a.asok 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:44:36.925 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83893/ceph-mon.a.asok config get fsid 2026-02-19T12:44:36.980 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:44:36.980 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:44:36.981 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:44:36.981 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:44:36.981 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:44:36.982 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:44:36.982 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:44:36.982 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:44:36.982 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:44:36.982 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:36.983 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:36.983 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83893/ceph-mon.a.asok 2026-02-19T12:44:36.983 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:44:36.983 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83893/ceph-mon.a.asok config get mon_host 2026-02-19T12:44:37.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-19T12:44:37.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:37.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:44:37.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:44:37.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:44:37.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-19T12:44:37.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:44:37.152 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:44:37.152 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:37.152 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:37.152 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:37.152 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:37.153 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:37.153 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:37.153 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:44:37.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:44:37.173 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:44:37.173 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:37.173 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:37.173 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:37.174 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:37.175 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:44:37.176 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:37.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0e434350-f641-4354-b485-b9c0a1ed7e08 2026-02-19T12:44:37.177 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0e434350-f641-4354-b485-b9c0a1ed7e08' 2026-02-19T12:44:37.177 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 0e434350-f641-4354-b485-b9c0a1ed7e08 2026-02-19T12:44:37.178 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:37.184 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC1BZdpjtrtChAAYpD6pcFW4FuzYPpeYStS2w== 2026-02-19T12:44:37.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC1BZdpjtrtChAAYpD6pcFW4FuzYPpeYStS2w=="}' 2026-02-19T12:44:37.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0e434350-f641-4354-b485-b9c0a1ed7e08 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-19T12:44:37.295 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:37.303 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-19T12:44:37.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC1BZdpjtrtChAAYpD6pcFW4FuzYPpeYStS2w== --osd-uuid 0e434350-f641-4354-b485-b9c0a1ed7e08 2026-02-19T12:44:37.319 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:37.315+0000 7f6c06a85a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:37.321 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:37.315+0000 7f6c06a85a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:37.322 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:37.319+0000 7f6c06a85a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:37.322 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:37.319+0000 7f6c06a85a40 -1 bdev(0x5615dcb0cc00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:37.322 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:37.319+0000 7f6c06a85a40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-19T12:44:38.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-19T12:44:38.848 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:38.849 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:44:38.849 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:44:38.850 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:39.141 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:44:39.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:44:39.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:39.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:39.143 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:39.143 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:39.157 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:39.155+0000 7f2fa3ecaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:39.159 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:39.155+0000 7f2fa3ecaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:39.160 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:39.155+0000 7f2fa3ecaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:39.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:44:39.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:39.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:44:39.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:39.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:39.364 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:39.365 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:39.365 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:39.365 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:39.365 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:39.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:39.763 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:39.759+0000 7f2fa3ecaa40 -1 Falling back to public interface 2026-02-19T12:44:40.577 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:40.577 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:40.578 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:40.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:40.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:40.579 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:40.790 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:40.927 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:40.923+0000 7f2fa3ecaa40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:44:41.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:41.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:41.791 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:41.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:44:41.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:41.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:44:42.003 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4081374616,v1:127.0.0.1:6803/4081374616] [v2:127.0.0.1:6804/4081374616,v1:127.0.0.1:6805/4081374616] exists,up 0e434350-f641-4354-b485-b9c0a1ed7e08 2026-02-19T12:44:42.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:42.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:42.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:42.004 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=85369 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:42.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:42.006 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:42.007 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T12:44:42.008 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:42.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=40ee6289-b175-49f8-8c21-ebd412666ad5 2026-02-19T12:44:42.009 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 40ee6289-b175-49f8-8c21-ebd412666ad5' 2026-02-19T12:44:42.010 INFO:tasks.workunit.client.0.trial109.stdout:add osd1 40ee6289-b175-49f8-8c21-ebd412666ad5 2026-02-19T12:44:42.010 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:42.021 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC6BZdpuTI6ARAARa1XUWV/XJxa43A5PqqCjA== 2026-02-19T12:44:42.021 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC6BZdpuTI6ARAARa1XUWV/XJxa43A5PqqCjA=="}' 2026-02-19T12:44:42.021 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 40ee6289-b175-49f8-8c21-ebd412666ad5 -i td/osd-bluefs-volume-ops/1/new.json 2026-02-19T12:44:42.227 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:42.236 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-19T12:44:42.237 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC6BZdpuTI6ARAARa1XUWV/XJxa43A5PqqCjA== --osd-uuid 40ee6289-b175-49f8-8c21-ebd412666ad5 2026-02-19T12:44:42.253 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:42.251+0000 7f2e61612a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:42.255 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:42.251+0000 7f2e61612a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:42.256 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:42.251+0000 7f2e61612a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:42.256 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:42.251+0000 7f2e61612a40 -1 bdev(0x55e8dc2a8c00 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:42.256 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:42.251+0000 7f2e61612a40 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-19T12:44:43.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-19T12:44:43.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:43.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T12:44:43.713 INFO:tasks.workunit.client.0.trial109.stdout:adding osd1 key to auth repository 2026-02-19T12:44:43.713 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:44.009 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:44:44.010 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T12:44:44.010 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:44.010 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:44.011 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:44.011 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:44.026 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:44.023+0000 7f1789624a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:44.027 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:44.023+0000 7f1789624a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:44.028 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:44.023+0000 7f1789624a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:44.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T12:44:44.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:44.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:44:44.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:44.224 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:44.225 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:44.225 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:44.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:44.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:44.226 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:44:44.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:44.511 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:44.507+0000 7f1789624a40 -1 Falling back to public interface 2026-02-19T12:44:45.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:45.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:45.433 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:45.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:45.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:45.434 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:44:45.640 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:45.710 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:45.707+0000 7f1789624a40 -1 osd.1 0 log_to_monitors true 2026-02-19T12:44:46.641 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:46.641 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:46.642 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:46.642 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:44:46.642 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:46.643 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:44:46.852 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1513143659,v1:127.0.0.1:6811/1513143659] [v2:127.0.0.1:6812/1513143659,v1:127.0.0.1:6813/1513143659] exists,up 40ee6289-b175-49f8-8c21-ebd412666ad5 2026-02-19T12:44:46.852 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:46.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:46.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:46.853 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T12:44:46.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=87516 2026-02-19T12:44:46.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-19T12:44:46.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:46.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:46.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:46.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:46.858 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:46.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T12:44:46.860 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:46.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 2026-02-19T12:44:46.860 INFO:tasks.workunit.client.0.trial109.stdout:add osd2 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 2026-02-19T12:44:46.861 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9' 2026-02-19T12:44:46.861 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:46.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC+BZdpUZjIMxAAzUwldvLckFMQkesRwpgLyQ== 2026-02-19T12:44:46.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC+BZdpUZjIMxAAzUwldvLckFMQkesRwpgLyQ=="}' 2026-02-19T12:44:46.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 -i td/osd-bluefs-volume-ops/2/new.json 2026-02-19T12:44:47.087 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:47.096 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-19T12:44:47.097 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC+BZdpUZjIMxAAzUwldvLckFMQkesRwpgLyQ== --osd-uuid 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 2026-02-19T12:44:47.114 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:47.111+0000 7fc866c7ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:47.116 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:47.111+0000 7fc866c7ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:47.116 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:47.111+0000 7fc866c7ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:47.117 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:47.115+0000 7fc866c7ea40 -1 bdev(0x5576c2b26c00 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:47.117 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:47.115+0000 7fc866c7ea40 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-19T12:44:48.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-19T12:44:48.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:48.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T12:44:48.581 INFO:tasks.workunit.client.0.trial109.stdout:adding osd2 key to auth repository 2026-02-19T12:44:48.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:48.873 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:44:48.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T12:44:48.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:48.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:48.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:48.875 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:48.890 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:48.887+0000 7f25ff509a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:48.891 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:48.887+0000 7f25ff509a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:48.892 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:48.887+0000 7f25ff509a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:49.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T12:44:49.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:49.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:44:49.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:49.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:49.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:49.081 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:49.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:49.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:49.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:44:49.296 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:49.435 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:49.431+0000 7f25ff509a40 -1 Falling back to public interface 2026-02-19T12:44:50.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:50.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:50.298 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:50.298 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:50.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:50.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:44:50.510 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:50.637 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:50.635+0000 7f25ff509a40 -1 osd.2 0 log_to_monitors true 2026-02-19T12:44:51.511 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:51.512 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:51.512 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:51.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:44:51.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:51.513 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:44:51.723 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2820215000,v1:127.0.0.1:6819/2820215000] [v2:127.0.0.1:6820/2820215000,v1:127.0.0.1:6821/2820215000] exists,up 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 2026-02-19T12:44:51.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:51.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:51.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:51.724 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=90028 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:44:51.725 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:44:51.726 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:44:51.726 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:44:51.726 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:44:51.726 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:44:51.726 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:44:51.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T12:44:51.728 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:44:51.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ee0bd45f-b1cc-425d-a359-7e172d87ae55 2026-02-19T12:44:51.729 INFO:tasks.workunit.client.0.trial109.stdout:add osd3 ee0bd45f-b1cc-425d-a359-7e172d87ae55 2026-02-19T12:44:51.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 ee0bd45f-b1cc-425d-a359-7e172d87ae55' 2026-02-19T12:44:51.730 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:44:51.741 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDDBZdpjmQmLBAAimjjdYHD/lzFzVO875Qzaw== 2026-02-19T12:44:51.741 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDDBZdpjmQmLBAAimjjdYHD/lzFzVO875Qzaw=="}' 2026-02-19T12:44:51.741 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ee0bd45f-b1cc-425d-a359-7e172d87ae55 -i td/osd-bluefs-volume-ops/3/new.json 2026-02-19T12:44:51.965 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:44:51.976 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-19T12:44:51.977 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDDBZdpjmQmLBAAimjjdYHD/lzFzVO875Qzaw== --osd-uuid ee0bd45f-b1cc-425d-a359-7e172d87ae55 2026-02-19T12:44:52.000 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:51.995+0000 7fcac7433a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:52.002 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:51.999+0000 7fcac7433a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:52.003 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:51.999+0000 7fcac7433a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:52.003 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:51.999+0000 7fcac7433a40 -1 bdev(0x56198de96c00 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-19T12:44:52.003 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:51.999+0000 7fcac7433a40 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-19T12:44:53.476 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-19T12:44:53.477 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:44:53.478 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-19T12:44:53.478 INFO:tasks.workunit.client.0.trial109.stdout:adding osd3 key to auth repository 2026-02-19T12:44:53.478 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:44:53.760 INFO:tasks.workunit.client.0.trial109.stdout:start osd.3 2026-02-19T12:44:53.761 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-19T12:44:53.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:44:53.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:44:53.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:44:53.762 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:44:53.784 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:53.779+0000 7fece7ec9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:53.785 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:53.783+0000 7fece7ec9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:53.786 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:53.783+0000 7fece7ec9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:44:53.977 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-19T12:44:53.977 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:44:53.977 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T12:44:53.977 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:44:53.977 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:44:53.977 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:53.978 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:44:53.978 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:44:53.978 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:53.978 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:44:54.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:54.279 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:54.275+0000 7fece7ec9a40 -1 Falling back to public interface 2026-02-19T12:44:55.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:55.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:55.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:44:55.200 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:44:55.201 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:55.201 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:44:55.401 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:44:55.472 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:44:55.467+0000 7fece7ec9a40 -1 osd.3 0 log_to_monitors true 2026-02-19T12:44:56.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:44:56.403 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:44:56.403 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:44:56.403 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:44:56.404 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:44:56.404 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:44:56.611 INFO:tasks.workunit.client.0.trial109.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1248210465,v1:127.0.0.1:6827/1248210465] [v2:127.0.0.1:6828/1248210465,v1:127.0.0.1:6829/1248210465] exists,up ee0bd45f-b1cc-425d-a359-7e172d87ae55 2026-02-19T12:44:56.612 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:44:56.612 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:44:56.612 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:44:56.612 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T12:44:56.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=92201 2026-02-19T12:44:56.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-19T12:45:01.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-19T12:45:01.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-19T12:45:01.863 INFO:tasks.workunit.client.0.trial109.stderr:pool 'foo' already exists 2026-02-19T12:45:01.875 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:45:02.877 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T12:45:02.897 INFO:tasks.workunit.client.0.trial109.stdout:hints = 1 2026-02-19T12:45:02.897 INFO:tasks.workunit.client.0.trial109.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T12:45:02.898 INFO:tasks.workunit.client.0.trial109.stdout:Object prefix: benchmark_data_trial109_93382 2026-02-19T12:45:02.898 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:45:02.898 INFO:tasks.workunit.client.0.trial109.stdout: 0 0 0 0 0 0 - 0 2026-02-19T12:45:03.897 INFO:tasks.workunit.client.0.trial109.stdout: 1 16 10660 10644 41.5747 41.5781 0.00166326 0.00150074 2026-02-19T12:45:04.897 INFO:tasks.workunit.client.0.trial109.stdout: 2 16 21727 21711 42.4008 43.2305 0.001419 0.00147207 2026-02-19T12:45:05.897 INFO:tasks.workunit.client.0.trial109.stdout: 3 16 32538 32522 42.3429 42.2305 0.00134376 0.00147416 2026-02-19T12:45:06.897 INFO:tasks.workunit.client.0.trial109.stdout: 4 16 43385 43369 42.3492 42.3711 0.00437424 0.00147378 2026-02-19T12:45:07.898 INFO:tasks.workunit.client.0.trial109.stdout: 5 16 51360 51344 40.1093 31.1523 0.0177055 0.00155376 2026-02-19T12:45:08.898 INFO:tasks.workunit.client.0.trial109.stdout: 6 16 61943 61927 40.3134 41.3398 0.00299755 0.00154851 2026-02-19T12:45:09.898 INFO:tasks.workunit.client.0.trial109.stdout: 7 16 72735 72719 40.5762 42.1562 0.00671102 0.0015379 2026-02-19T12:45:10.898 INFO:tasks.workunit.client.0.trial109.stdout: 8 16 83543 83527 40.7811 42.2188 0.00184636 0.00153101 2026-02-19T12:45:11.898 INFO:tasks.workunit.client.0.trial109.stdout: 9 16 94207 94191 40.878 41.6562 0.000944335 0.00152737 2026-02-19T12:45:12.898 INFO:tasks.workunit.client.0.trial109.stdout: 10 16 105057 105041 41.0281 42.3828 0.00429004 0.00152144 2026-02-19T12:45:13.898 INFO:tasks.workunit.client.0.trial109.stdout: 11 16 106244 106228 37.7198 4.63672 0.0968486 0.00164679 2026-02-19T12:45:14.898 INFO:tasks.workunit.client.0.trial109.stdout: 12 15 110956 110941 36.1106 18.4102 0.00178946 0.00172924 2026-02-19T12:45:15.898 INFO:tasks.workunit.client.0.trial109.stdout: 13 16 121894 121878 36.6189 42.7227 0.0016359 0.00170527 2026-02-19T12:45:16.898 INFO:tasks.workunit.client.0.trial109.stdout: 14 16 132721 132705 37.024 42.293 0.00126266 0.00168613 2026-02-19T12:45:17.898 INFO:tasks.workunit.client.0.trial109.stdout: 15 16 142804 142788 37.1813 39.3867 0.00207762 0.00167944 2026-02-19T12:45:18.898 INFO:tasks.workunit.client.0.trial109.stdout: 16 16 152230 152214 37.1586 36.8203 0.00161326 0.00168048 2026-02-19T12:45:19.898 INFO:tasks.workunit.client.0.trial109.stdout: 17 16 159427 159411 36.6264 28.1133 0.0401329 0.0016823 2026-02-19T12:45:20.899 INFO:tasks.workunit.client.0.trial109.stdout: 18 16 161504 161488 35.0423 8.11328 0.00148687 0.00178206 2026-02-19T12:45:21.899 INFO:tasks.workunit.client.0.trial109.stdout: 19 16 170614 170598 35.0708 35.5859 0.00163254 0.0017806 2026-02-19T12:45:22.898 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:45:22.898718+0000 min lat: 0.000451509 max lat: 0.614937 avg lat: 0.00177845 2026-02-19T12:45:22.899 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:45:22.899 INFO:tasks.workunit.client.0.trial109.stdout: 20 16 179809 179793 35.113 35.918 0.00197687 0.00177845 2026-02-19T12:45:23.898 INFO:tasks.workunit.client.0.trial109.stdout: 21 16 189057 189041 35.161 36.125 0.00175594 0.00177605 2026-02-19T12:45:24.899 INFO:tasks.workunit.client.0.trial109.stdout: 22 16 198300 198284 35.2038 36.1055 0.00168763 0.00177388 2026-02-19T12:45:25.899 INFO:tasks.workunit.client.0.trial109.stdout: 23 16 206327 206311 35.0364 31.3555 0.0233561 0.00177505 2026-02-19T12:45:26.899 INFO:tasks.workunit.client.0.trial109.stdout: 24 16 206460 206444 33.5982 0.519531 0.0741768 0.00185136 2026-02-19T12:45:27.899 INFO:tasks.workunit.client.0.trial109.stdout: 25 15 208121 208106 32.514 6.49219 0.00202591 0.00192075 2026-02-19T12:45:28.909 INFO:tasks.workunit.client.0.trial109.stdout: 26 16 217012 216996 32.599 34.7266 0.00184844 0.00191574 2026-02-19T12:45:29.899 INFO:tasks.workunit.client.0.trial109.stdout: 27 16 226035 226019 32.6969 35.2461 0.00194963 0.00191001 2026-02-19T12:45:30.899 INFO:tasks.workunit.client.0.trial109.stdout: 28 16 235088 235072 32.7921 35.3633 0.00126965 0.00190446 2026-02-19T12:45:31.899 INFO:tasks.workunit.client.0.trial109.stdout: 29 16 244012 243996 32.8632 34.8594 0.00139083 0.00190036 2026-02-19T12:45:32.899 INFO:tasks.workunit.client.0.trial109.stdout:Total time run: 30.0013 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Total writes made: 252943 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Write size: 4096 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Object size: 4096 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Bandwidth (MB/sec): 32.9339 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Bandwidth: 12.627 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Max bandwidth (MB/sec): 43.2305 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Min bandwidth (MB/sec): 0.519531 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Average IOPS: 8431 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Stddev IOPS: 3232.52 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Max IOPS: 11067 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Min IOPS: 133 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Average Latency(s): 0.00189629 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Latency(s): 0.00742413 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Max latency(s): 0.614937 2026-02-19T12:45:32.900 INFO:tasks.workunit.client.0.trial109.stdout:Min latency(s): 0.000451509 2026-02-19T12:45:32.903 INFO:tasks.workunit.client.0.trial109.stdout:after bench 2026-02-19T12:45:32.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-19T12:45:32.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 85369 2026-02-19T12:45:32.903 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-19T12:45:33.905 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 85369 2026-02-19T12:45:33.905 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (85369) - No such process 2026-02-19T12:45:33.905 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-19T12:45:34.126 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:45:34.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 87516 2026-02-19T12:45:34.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-19T12:45:35.137 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 87516 2026-02-19T12:45:35.137 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (87516) - No such process 2026-02-19T12:45:35.137 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-19T12:45:35.356 INFO:tasks.workunit.client.0.trial109.stderr:osd.1 is already down. 2026-02-19T12:45:35.365 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 90028 2026-02-19T12:45:35.365 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-19T12:45:36.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 90028 2026-02-19T12:45:36.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (90028) - No such process 2026-02-19T12:45:36.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-19T12:45:36.576 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already down. 2026-02-19T12:45:36.587 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 92201 2026-02-19T12:45:36.587 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-19T12:45:37.589 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 92201 2026-02-19T12:45:37.589 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (92201) - No such process 2026-02-19T12:45:37.590 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-19T12:45:37.870 INFO:tasks.workunit.client.0.trial109.stderr:osd.3 is already down. 2026-02-19T12:45:37.881 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:45:41.929 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:45:41.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:45:45.973 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:45:46.012 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T12:45:50.069 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:45:50.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:45:54.128 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:45:54.167 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-19T12:45:54.168 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-19T12:45:54.185 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:45:57.568 INFO:tasks.workunit.client.0.trial109.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-19T12:45:57.569 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-19T12:45:57.569 INFO:tasks.workunit.client.0.trial109.stdout:2 : device size 0x100000000(4 GiB) : using 0xae45f000(2.7 GiB) 2026-02-19T12:45:57.569 INFO:tasks.workunit.client.0.trial109.stdout:Expanding DB/WAL... 2026-02-19T12:45:57.569 INFO:tasks.workunit.client.0.trial109.stdout:0 : nothing to do, skipped 2026-02-19T12:45:57.569 INFO:tasks.workunit.client.0.trial109.stdout:1 : nothing to do, skipped 2026-02-19T12:45:57.569 INFO:tasks.workunit.client.0.trial109.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-19T12:45:57.569 INFO:tasks.workunit.client.0.trial109.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-19T12:46:01.310 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 11811160064 2026-02-19T12:46:01.311 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2026-02-19T12:46:01.331 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:04.694 INFO:tasks.workunit.client.0.trial109.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-19T12:46:04.694 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-19T12:46:04.694 INFO:tasks.workunit.client.0.trial109.stdout:2 : device size 0x2c0000000(11 GiB) : using 0x26e4bd000(9.7 GiB) 2026-02-19T12:46:04.694 INFO:tasks.workunit.client.0.trial109.stdout:Expanding DB/WAL... 2026-02-19T12:46:04.694 INFO:tasks.workunit.client.0.trial109.stdout:0 : nothing to do, skipped 2026-02-19T12:46:04.694 INFO:tasks.workunit.client.0.trial109.stdout:1 : nothing to do, skipped 2026-02-19T12:46:04.694 INFO:tasks.workunit.client.0.trial109.stdout:2 : Expanding to 0x2c0000000(11 GiB) 2026-02-19T12:46:04.695 INFO:tasks.workunit.client.0.trial109.stdout:2 : size updated to 0x2c0000000(11 GiB) 2026-02-19T12:46:08.419 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2026-02-19T12:46:08.420 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2026-02-19T12:46:08.439 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:11.856 INFO:tasks.workunit.client.0.trial109.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-19T12:46:11.857 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-19T12:46:11.857 INFO:tasks.workunit.client.0.trial109.stdout:2 : device size 0x100020000(4.0 GiB) : using 0xae55b000(2.7 GiB) 2026-02-19T12:46:11.857 INFO:tasks.workunit.client.0.trial109.stdout:Expanding DB/WAL... 2026-02-19T12:46:11.857 INFO:tasks.workunit.client.0.trial109.stdout:0 : nothing to do, skipped 2026-02-19T12:46:11.857 INFO:tasks.workunit.client.0.trial109.stdout:1 : nothing to do, skipped 2026-02-19T12:46:11.857 INFO:tasks.workunit.client.0.trial109.stdout:2 : Expanding to 0x100020000(4.0 GiB) 2026-02-19T12:46:11.857 INFO:tasks.workunit.client.0.trial109.stdout:2 : size updated to 0x100020000(4.0 GiB) 2026-02-19T12:46:15.562 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:81: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2026-02-19T12:46:15.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:82: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2026-02-19T12:46:15.582 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:19.004 INFO:tasks.workunit.client.0.trial109.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-19T12:46:19.004 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-19T12:46:19.005 INFO:tasks.workunit.client.0.trial109.stdout:2 : device size 0xfff00000(4.0 GiB) : using 0xae5b7000(2.7 GiB) 2026-02-19T12:46:19.005 INFO:tasks.workunit.client.0.trial109.stdout:Expanding DB/WAL... 2026-02-19T12:46:19.005 INFO:tasks.workunit.client.0.trial109.stdout:0 : nothing to do, skipped 2026-02-19T12:46:19.005 INFO:tasks.workunit.client.0.trial109.stdout:1 : nothing to do, skipped 2026-02-19T12:46:19.005 INFO:tasks.workunit.client.0.trial109.stdout:2 : Expanding to 0xfff00000(4.0 GiB) 2026-02-19T12:46:19.005 INFO:tasks.workunit.client.0.trial109.stdout:2 : size updated to 0xfff00000(4.0 GiB) 2026-02-19T12:46:22.680 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:46:23.557 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:23.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:46:24.465 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:24.501 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:87: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T12:46:25.368 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:25.405 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:46:26.268 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:26.304 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-19T12:46:26.324 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:26.525 INFO:tasks.workunit.client.0.trial109.stdout:0 : device size 0x20000000(512 MiB) : using 0x500000(5 MiB) 2026-02-19T12:46:26.525 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x40000000(1 GiB) : using 0x4000000(64 MiB) 2026-02-19T12:46:26.525 INFO:tasks.workunit.client.0.trial109.stdout:2 : device size 0x100000000(4 GiB) : using 0x2e45f000(740 MiB) 2026-02-19T12:46:26.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:92: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2026-02-19T12:46:26.702 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:27.256 INFO:tasks.workunit.client.0.trial109.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-19T12:46:27.260 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:97: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:46:28.077 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:28.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:100: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-19T12:46:28.123 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:28.712 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-19T12:46:28.718 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:105: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:46:29.508 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:29.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:108: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2026-02-19T12:46:29.555 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:30.165 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-19T12:46:30.165 INFO:tasks.workunit.client.0.trial109.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-19T12:46:30.170 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:114: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T12:46:30.917 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:30.946 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:117: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2026-02-19T12:46:30.964 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:31.081 INFO:tasks.workunit.client.0.trial109.stderr:Migrate to WAL device isn't supported. 2026-02-19T12:46:31.083 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:123: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-19T12:46:31.083 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:126: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:46:31.989 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:32.026 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:129: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-19T12:46:32.045 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:32.585 INFO:tasks.workunit.client.0.trial109.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-19T12:46:32.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:46:33.393 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:33.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:136: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2026-02-19T12:46:33.441 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:46:33.828 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:46:34.681 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:46:34.720 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:46:34.721 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:46:34.722 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:46:34.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:46:34.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:46:34.723 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:46:34.723 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:46:34.724 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:46:34.724 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:46:34.725 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T12:46:34.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:46:34.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:46:34.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:46:34.725 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:46:34.741 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:34.737+0000 7ff55ed00a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:34.743 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:34.737+0000 7ff55ed00a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:34.744 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:34.737+0000 7ff55ed00a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:34.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:46:34.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:46:34.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:46:34.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:46:34.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:46:34.933 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:34.934 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:46:34.934 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:46:34.934 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:34.934 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:46:35.153 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:35.210 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:35.205+0000 7ff55ed00a40 -1 Falling back to public interface 2026-02-19T12:46:36.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:36.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:36.154 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:46:36.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:46:36.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:36.154 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:46:36.365 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:37.062 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:37.057+0000 7ff55ed00a40 -1 osd.0 23 log_to_monitors true 2026-02-19T12:46:37.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:37.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:37.366 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:46:37.366 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:46:37.367 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:37.367 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:46:37.584 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 31 up_thru 31 down_at 23 last_clean_interval [5,23) [v2:127.0.0.1:6802/2509096895,v1:127.0.0.1:6803/2509096895] [v2:127.0.0.1:6804/2509096895,v1:127.0.0.1:6805/2509096895] exists,up 0e434350-f641-4354-b485-b9c0a1ed7e08 2026-02-19T12:46:37.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:46:37.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:46:37.585 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:46:37.585 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:46:37.587 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid0=104038 2026-02-19T12:46:37.587 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T12:46:37.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:46:37.589 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:46:37.590 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:37.590 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:46:37.591 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T12:46:37.592 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:46:37.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:46:37.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:46:37.593 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-19T12:46:37.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:46:37.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:46:37.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:46:37.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:46:37.609 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:37.605+0000 7fd347143a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:37.610 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:37.605+0000 7fd347143a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:37.611 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:37.605+0000 7fd347143a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:37.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:46:37.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:46:37.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:46:37.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:46:37.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:46:37.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:37.809 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:46:37.809 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:46:37.809 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:37.809 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:46:38.018 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:38.013+0000 7fd347143a40 -1 Falling back to public interface 2026-02-19T12:46:38.021 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:39.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:39.022 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:39.023 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:46:39.023 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:46:39.023 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:39.024 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:46:39.246 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:39.821 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:39.817+0000 7fd347143a40 -1 osd.1 24 log_to_monitors true 2026-02-19T12:46:40.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:40.248 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:40.249 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:46:40.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:46:40.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:40.249 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:46:40.456 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 35 up_thru 35 down_at 25 last_clean_interval [9,24) [v2:127.0.0.1:6810/2086308940,v1:127.0.0.1:6811/2086308940] [v2:127.0.0.1:6812/2086308940,v1:127.0.0.1:6813/2086308940] exists,up 40ee6289-b175-49f8-8c21-ebd412666ad5 2026-02-19T12:46:40.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:46:40.456 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:46:40.457 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:46:40.457 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T12:46:40.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid1=104979 2026-02-19T12:46:40.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-19T12:46:40.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:46:40.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:46:40.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:46:40.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:46:40.460 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:46:40.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:46:40.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:46:40.463 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:46:40.463 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:46:40.463 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T12:46:40.463 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:46:40.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:46:40.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:46:40.464 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-19T12:46:40.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:46:40.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:46:40.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:46:40.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:46:40.481 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:40.477+0000 7fc682999a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:40.482 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:40.477+0000 7fc682999a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:40.483 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:40.477+0000 7fc682999a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:40.672 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:46:40.672 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:46:40.672 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:46:40.672 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:46:40.672 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:46:40.673 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:40.673 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:46:40.673 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:46:40.673 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:40.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:46:40.810 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:40.805+0000 7fc682999a40 -1 Falling back to public interface 2026-02-19T12:46:40.883 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:41.885 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:41.885 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:41.885 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:46:41.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:46:41.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:41.886 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:46:42.105 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:42.546 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:42.541+0000 7fc682999a40 -1 osd.2 26 log_to_monitors true 2026-02-19T12:46:43.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:43.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:43.106 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:46:43.106 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:46:43.107 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:43.107 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:46:43.318 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 38 up_thru 38 down_at 27 last_clean_interval [14,26) [v2:127.0.0.1:6818/3590420465,v1:127.0.0.1:6819/3590420465] [v2:127.0.0.1:6820/3590420465,v1:127.0.0.1:6821/3590420465] exists,up 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 2026-02-19T12:46:43.319 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:46:43.319 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:46:43.319 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:46:43.319 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid2=105920 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:149: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T12:46:43.324 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:46:43.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:46:43.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:46:43.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:46:43.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T12:46:43.327 INFO:tasks.workunit.client.0.trial109.stdout:start osd.3 2026-02-19T12:46:43.328 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T12:46:43.328 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:46:43.328 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-19T12:46:43.328 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T12:46:43.328 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:46:43.329 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:46:43.329 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:46:43.342 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:43.337+0000 7f1707e6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:43.343 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:43.337+0000 7f1707e6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:43.344 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:43.337+0000 7f1707e6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:46:43.535 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T12:46:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:46:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T12:46:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:46:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:46:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:43.536 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:46:43.536 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:46:43.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:43.537 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:46:43.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:43.806 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:43.801+0000 7f1707e6ba40 -1 Falling back to public interface 2026-02-19T12:46:44.752 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:44.752 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:44.752 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:46:44.753 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:46:44.753 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:44.753 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:46:44.967 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:46:45.599 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:46:45.593+0000 7f1707e6ba40 -1 osd.3 28 log_to_monitors true 2026-02-19T12:46:45.968 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:46:45.969 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:46:45.969 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:46:45.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:46:45.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:46:45.970 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:46:46.183 INFO:tasks.workunit.client.0.trial109.stdout:osd.3 up in weight 1 up_from 42 up_thru 42 down_at 29 last_clean_interval [18,28) [v2:127.0.0.1:6826/2006020066,v1:127.0.0.1:6827/2006020066] [v2:127.0.0.1:6828/2006020066,v1:127.0.0.1:6829/2006020066] exists,up ee0bd45f-b1cc-425d-a359-7e172d87ae55 2026-02-19T12:46:46.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:46:46.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:46:46.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:46:46.187 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T12:46:46.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: osd_pid3=106856 2026-02-19T12:46:46.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:152: TEST_bluestore: wait_for_clean 2026-02-19T12:46:46.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:46:46.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:46:46.187 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:46:46.187 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:46:46.188 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:46:46.188 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:46:46.188 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:46:46.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:46:46.189 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:46:46.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:46:46.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:46:46.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:46:46.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:46:46.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:46:46.289 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:46:46.508 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:46:46.509 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:46:46.509 INFO:tasks.workunit.client.0.trial109.stderr:2 2026-02-19T12:46:46.509 INFO:tasks.workunit.client.0.trial109.stderr:3' 2026-02-19T12:46:46.509 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:46:46.509 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:46:46.510 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:46:46.586 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-19T12:46:46.586 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-19T12:46:46.586 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180' 2026-02-19T12:46:46.586 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:46:46.586 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:46:46.665 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855364 2026-02-19T12:46:46.665 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855364 2026-02-19T12:46:46.665 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180 1-150323855364' 2026-02-19T12:46:46.665 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:46:46.665 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:46:46.741 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-19T12:46:46.741 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-19T12:46:46.742 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180 1-150323855364 2-163208757251' 2026-02-19T12:46:46.742 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:46:46.742 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-19T12:46:46.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626435 2026-02-19T12:46:46.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626435 2026-02-19T12:46:46.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180 1-150323855364 2-163208757251 3-180388626435' 2026-02-19T12:46:46.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:46:46.821 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986180 2026-02-19T12:46:46.821 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:46:46.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:46:46.823 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-133143986180 2026-02-19T12:46:46.823 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:46:46.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=133143986180 2026-02-19T12:46:46.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 133143986180' 2026-02-19T12:46:46.825 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 133143986180 2026-02-19T12:46:46.826 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:46:47.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 133143986178 -lt 133143986180 2026-02-19T12:46:47.040 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:46:48.041 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:46:48.042 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:46:48.252 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 133143986181 -lt 133143986180 2026-02-19T12:46:48.253 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:46:48.253 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-150323855364 2026-02-19T12:46:48.253 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:46:48.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:46:48.255 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-150323855364 2026-02-19T12:46:48.255 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:46:48.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855364 2026-02-19T12:46:48.257 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 150323855364' 2026-02-19T12:46:48.257 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 150323855364 2026-02-19T12:46:48.257 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:46:48.478 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855364 -lt 150323855364 2026-02-19T12:46:48.478 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:46:48.479 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-19T12:46:48.479 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:46:48.480 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:46:48.481 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757251 2026-02-19T12:46:48.481 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:46:48.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-19T12:46:48.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-19T12:46:48.483 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 163208757251 2026-02-19T12:46:48.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:46:48.707 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757252 -lt 163208757251 2026-02-19T12:46:48.707 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:46:48.708 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-180388626435 2026-02-19T12:46:48.708 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:46:48.709 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-19T12:46:48.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-180388626435 2026-02-19T12:46:48.710 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:46:48.711 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=180388626435 2026-02-19T12:46:48.712 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.3 seq 180388626435 2026-02-19T12:46:48.712 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 180388626435' 2026-02-19T12:46:48.712 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-19T12:46:48.934 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-19T12:46:48.934 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:46:48.935 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:46:48.935 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:46:49.235 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T12:46:49.235 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:46:49.235 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:46:49.236 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:46:49.236 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:46:49.236 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:46:49.236 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:46:49.236 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:46:49.445 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T12:46:49.446 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:46:49.446 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:46:49.446 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:46:49.731 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T12:46:49.731 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:46:49.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:46:49.732 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:155: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T12:46:49.749 INFO:tasks.workunit.client.0.trial109.stdout:hints = 1 2026-02-19T12:46:49.749 INFO:tasks.workunit.client.0.trial109.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T12:46:49.749 INFO:tasks.workunit.client.0.trial109.stdout:Object prefix: benchmark_data_trial109_108165 2026-02-19T12:46:49.749 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:46:49.749 INFO:tasks.workunit.client.0.trial109.stdout: 0 0 0 0 0 0 - 0 2026-02-19T12:46:50.748 INFO:tasks.workunit.client.0.trial109.stdout: 1 16 9715 9699 37.8838 37.8867 0.00158761 0.00164682 2026-02-19T12:46:51.749 INFO:tasks.workunit.client.0.trial109.stdout: 2 15 19217 19202 37.5011 37.1211 0.00130519 0.00166428 2026-02-19T12:46:52.749 INFO:tasks.workunit.client.0.trial109.stdout: 3 16 28569 28553 37.1756 36.5273 0.00129472 0.00167904 2026-02-19T12:46:53.749 INFO:tasks.workunit.client.0.trial109.stdout: 4 16 38088 38072 37.1769 37.1836 0.001897 0.00167928 2026-02-19T12:46:54.749 INFO:tasks.workunit.client.0.trial109.stdout: 5 16 47540 47524 37.1254 36.9219 0.00145706 0.00168172 2026-02-19T12:46:55.749 INFO:tasks.workunit.client.0.trial109.stdout: 6 16 56958 56942 37.0689 36.7891 0.00196003 0.00168433 2026-02-19T12:46:56.749 INFO:tasks.workunit.client.0.trial109.stdout: 7 16 66499 66483 37.0971 37.2695 0.00297334 0.00168302 2026-02-19T12:46:57.749 INFO:tasks.workunit.client.0.trial109.stdout: 8 16 75937 75921 37.068 36.8672 0.00147474 0.00168448 2026-02-19T12:46:58.749 INFO:tasks.workunit.client.0.trial109.stdout: 9 16 85536 85520 37.1153 37.4961 0.00175104 0.00168232 2026-02-19T12:46:59.749 INFO:tasks.workunit.client.0.trial109.stdout: 10 16 95122 95106 37.1478 37.4453 0.00189282 0.0016809 2026-02-19T12:47:00.750 INFO:tasks.workunit.client.0.trial109.stdout: 11 16 104477 104461 37.0926 36.543 0.00214409 0.00168339 2026-02-19T12:47:01.750 INFO:tasks.workunit.client.0.trial109.stdout: 12 16 113882 113866 37.0628 36.7383 0.00141094 0.00168472 2026-02-19T12:47:02.750 INFO:tasks.workunit.client.0.trial109.stdout: 13 16 123136 123120 36.9923 36.1484 0.00176333 0.00168797 2026-02-19T12:47:03.750 INFO:tasks.workunit.client.0.trial109.stdout: 14 16 132587 132571 36.9868 36.918 0.00129641 0.00168823 2026-02-19T12:47:04.750 INFO:tasks.workunit.client.0.trial109.stdout: 15 16 142119 142103 37.0031 37.2344 0.00172235 0.00168749 2026-02-19T12:47:05.750 INFO:tasks.workunit.client.0.trial109.stdout: 16 16 151594 151578 37.0035 37.0117 0.0041008 0.00168742 2026-02-19T12:47:06.750 INFO:tasks.workunit.client.0.trial109.stdout: 17 16 160865 160849 36.9569 36.2148 0.00192643 0.00168967 2026-02-19T12:47:07.750 INFO:tasks.workunit.client.0.trial109.stdout: 18 16 170122 170106 36.9125 36.1602 0.00146315 0.0016917 2026-02-19T12:47:08.750 INFO:tasks.workunit.client.0.trial109.stdout: 19 16 176963 176947 36.3761 26.7227 0.0341671 0.00171249 2026-02-19T12:47:09.750 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:47:09.750670+0000 min lat: 0.000585388 max lat: 0.114032 avg lat: 0.00179953 2026-02-19T12:47:09.750 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:47:09.750 INFO:tasks.workunit.client.0.trial109.stdout: 20 16 177302 177286 34.6235 1.32422 0.0859336 0.00179953 2026-02-19T12:47:10.750 INFO:tasks.workunit.client.0.trial109.stdout: 21 16 177516 177500 33.0146 0.835938 0.0293126 0.0018876 2026-02-19T12:47:11.750 INFO:tasks.workunit.client.0.trial109.stdout: 22 16 177621 177605 31.5325 0.410156 0.0879 0.00198 2026-02-19T12:47:12.750 INFO:tasks.workunit.client.0.trial109.stdout: 23 16 178042 178026 30.2331 1.64453 0.00220722 0.00206569 2026-02-19T12:47:13.750 INFO:tasks.workunit.client.0.trial109.stdout: 24 16 187441 187425 30.503 36.7148 0.00140912 0.00204746 2026-02-19T12:47:14.750 INFO:tasks.workunit.client.0.trial109.stdout: 25 16 196733 196717 30.7347 36.2969 0.00167156 0.00203201 2026-02-19T12:47:15.751 INFO:tasks.workunit.client.0.trial109.stdout: 26 16 206002 205986 30.945 36.207 0.00253223 0.0020182 2026-02-19T12:47:16.751 INFO:tasks.workunit.client.0.trial109.stdout: 27 16 215548 215532 31.1799 37.2891 0.00171419 0.00200295 2026-02-19T12:47:17.751 INFO:tasks.workunit.client.0.trial109.stdout: 28 16 224957 224941 31.3789 36.7539 0.00118509 0.00199025 2026-02-19T12:47:18.751 INFO:tasks.workunit.client.0.trial109.stdout: 29 16 226827 226811 30.5487 7.30469 0.0973433 0.0020416 2026-02-19T12:47:19.751 INFO:tasks.workunit.client.0.trial109.stdout: 30 16 226964 226948 29.5483 0.535156 0.114673 0.00210818 2026-02-19T12:47:20.751 INFO:tasks.workunit.client.0.trial109.stdout:Total time run: 30.064 2026-02-19T12:47:20.751 INFO:tasks.workunit.client.0.trial109.stdout:Total writes made: 226964 2026-02-19T12:47:20.751 INFO:tasks.workunit.client.0.trial109.stdout:Write size: 4096 2026-02-19T12:47:20.751 INFO:tasks.workunit.client.0.trial109.stdout:Object size: 4096 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Bandwidth (MB/sec): 29.4897 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Bandwidth: 14.1751 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Max bandwidth (MB/sec): 37.8867 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Min bandwidth (MB/sec): 0.410156 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Average IOPS: 7549 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Stddev IOPS: 3628.83 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Max IOPS: 9699 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Min IOPS: 105 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Average Latency(s): 0.00211641 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Latency(s): 0.00672165 2026-02-19T12:47:20.752 INFO:tasks.workunit.client.0.trial109.stdout:Max latency(s): 0.460095 2026-02-19T12:47:20.753 INFO:tasks.workunit.client.0.trial109.stdout:Min latency(s): 0.000585388 2026-02-19T12:47:20.758 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 104038 2026-02-19T12:47:20.759 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2026-02-19T12:47:21.760 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 104038 2026-02-19T12:47:21.760 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (104038) - No such process 2026-02-19T12:47:21.760 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 0 2026-02-19T12:47:21.964 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:47:21.974 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 104979 2026-02-19T12:47:21.974 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2026-02-19T12:47:22.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 104979 2026-02-19T12:47:22.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (104979) - No such process 2026-02-19T12:47:22.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 1 2026-02-19T12:47:23.190 INFO:tasks.workunit.client.0.trial109.stderr:osd.1 is already down. 2026-02-19T12:47:23.202 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 105920 2026-02-19T12:47:23.202 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2026-02-19T12:47:24.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 105920 2026-02-19T12:47:24.203 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (105920) - No such process 2026-02-19T12:47:24.204 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 2 2026-02-19T12:47:24.414 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already down. 2026-02-19T12:47:24.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 106856 2026-02-19T12:47:24.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: sleep 1 2026-02-19T12:47:25.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 106856 2026-02-19T12:47:25.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 164: kill: (106856) - No such process 2026-02-19T12:47:25.426 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:165: TEST_bluestore: ceph osd down 3 2026-02-19T12:47:25.680 INFO:tasks.workunit.client.0.trial109.stderr:osd.3 is already down. 2026-02-19T12:47:25.689 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:47:29.208 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:47:29.250 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:170: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2026-02-19T12:47:29.581 INFO:tasks.workunit.client.0.trial109.stderr:512+0 records in 2026-02-19T12:47:29.581 INFO:tasks.workunit.client.0.trial109.stderr:512+0 records out 2026-02-19T12:47:29.581 INFO:tasks.workunit.client.0.trial109.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.329544 s, 1.6 GB/s 2026-02-19T12:47:29.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:171: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2026-02-19T12:47:29.599 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:47:32.812 INFO:tasks.workunit.client.0.trial109.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2026-02-19T12:47:32.838 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:175: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:47:36.412 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:47:36.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:47:40.324 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:47:40.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:180: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2026-02-19T12:47:41.000 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records in 2026-02-19T12:47:41.000 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records out 2026-02-19T12:47:41.001 INFO:tasks.workunit.client.0.trial109.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.623995 s, 1.7 GB/s 2026-02-19T12:47:41.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:181: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2026-02-19T12:47:41.013 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:47:44.928 INFO:tasks.workunit.client.0.trial109.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2026-02-19T12:47:44.951 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:185: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2026-02-19T12:47:44.968 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:47:48.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:190: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:47:52.312 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:47:52.361 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T12:47:55.648 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:47:55.685 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:195: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2026-02-19T12:47:55.703 INFO:tasks.workunit.client.0.trial109.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-19T12:47:55.703 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:47:58.336 INFO:tasks.workunit.client.0.trial109.stdout:DB device added 2026-02-19T12:47:58.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:198: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2026-02-19T12:47:58.371 INFO:tasks.workunit.client.0.trial109.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-19T12:47:58.371 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:48:01.112 INFO:tasks.workunit.client.0.trial109.stdout:WAL device added 2026-02-19T12:48:01.136 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:201: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2026-02-19T12:48:01.152 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:48:04.479 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:206: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T12:48:07.912 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:48:07.948 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:48:11.424 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:48:11.472 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:211: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2026-02-19T12:48:11.491 INFO:tasks.workunit.client.0.trial109.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-19T12:48:11.491 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:48:14.268 INFO:tasks.workunit.client.0.trial109.stdout:WAL device added 2026-02-19T12:48:14.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:214: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-19T12:48:14.309 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:48:17.680 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2026-02-19T12:48:17.710 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:48:21.084 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:48:21.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:48:21.129 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:48:21.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:48:21.131 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:48:21.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:48:21.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:48:21.132 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T12:48:21.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:48:21.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:48:21.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:48:21.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:48:21.149 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:21.147+0000 7fb45ebc5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:21.150 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:21.147+0000 7fb45ebc5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:21.151 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:21.147+0000 7fb45ebc5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:21.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:48:21.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:48:21.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:48:21.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:48:21.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:48:21.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:21.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:48:21.350 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:48:21.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:21.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:21.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:21.658 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:21.655+0000 7fb45ebc5a40 -1 Falling back to public interface 2026-02-19T12:48:22.559 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:22.559 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:22.559 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:48:22.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:48:22.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:22.560 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:22.777 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:23.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:23.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:23.779 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:48:23.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:48:23.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:23.780 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:23.996 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:24.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:24.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:24.998 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:48:24.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:48:24.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:24.999 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:25.208 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:26.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:26.209 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:26.210 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:48:26.210 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:48:26.211 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:26.211 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:26.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:27.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:27.423 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:27.424 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:48:27.424 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:48:27.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:27.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:27.637 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:28.639 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:28.639 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:28.639 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:48:28.640 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:48:28.640 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:28.640 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:28.856 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:29.016 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:29.015+0000 7fb45ebc5a40 -1 osd.0 44 log_to_monitors true 2026-02-19T12:48:29.857 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:29.858 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:29.858 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:48:29.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:48:29.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:29.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:48:30.066 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 52 up_thru 52 down_at 44 last_clean_interval [31,44) [v2:127.0.0.1:6802/593405532,v1:127.0.0.1:6803/593405532] [v2:127.0.0.1:6804/593405532,v1:127.0.0.1:6805/593405532] exists,up 0e434350-f641-4354-b485-b9c0a1ed7e08 2026-02-19T12:48:30.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:48:30.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:48:30.067 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:48:30.067 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid0=114316 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:48:30.071 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:48:30.072 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:48:30.073 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T12:48:30.074 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:48:30.074 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:48:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:48:30.075 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-19T12:48:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:48:30.075 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:48:30.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:48:30.076 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:48:30.094 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:30.091+0000 7f181f23ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:30.095 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:30.091+0000 7f181f23ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:30.096 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:30.095+0000 7f181f23ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:30.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:48:30.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:48:30.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:48:30.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:48:30.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:48:30.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:30.281 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:48:30.282 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:48:30.282 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:30.282 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:30.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:30.582 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:30.579+0000 7f181f23ba40 -1 Falling back to public interface 2026-02-19T12:48:31.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:31.491 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:31.492 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:48:31.492 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:48:31.492 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:31.493 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:31.702 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:32.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:32.703 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:32.703 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:48:32.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:48:32.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:32.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:32.922 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:33.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:33.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:33.923 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:48:33.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:48:33.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:33.923 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:34.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:35.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:35.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:35.134 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:48:35.134 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:48:35.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:35.135 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:35.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:36.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:36.349 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:36.350 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:48:36.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:48:36.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:36.351 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:36.554 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:37.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:37.555 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:37.555 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:48:37.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:48:37.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:37.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:37.764 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:38.765 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:38.765 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:38.766 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:48:38.766 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:48:38.766 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:38.766 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:38.903 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:38.899+0000 7f181f23ba40 -1 osd.1 45 log_to_monitors true 2026-02-19T12:48:38.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:39.972 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:39.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:39.973 INFO:tasks.workunit.client.0.trial109.stdout:8 2026-02-19T12:48:39.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T12:48:39.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:39.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:48:40.184 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 46 last_clean_interval [35,45) [v2:127.0.0.1:6810/3658661974,v1:127.0.0.1:6811/3658661974] [v2:127.0.0.1:6812/3658661974,v1:127.0.0.1:6813/3658661974] exists,up 40ee6289-b175-49f8-8c21-ebd412666ad5 2026-02-19T12:48:40.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:48:40.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:48:40.185 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:48:40.185 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T12:48:40.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid1=115387 2026-02-19T12:48:40.189 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:48:40.190 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:48:40.191 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:48:40.192 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:48:40.193 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:48:40.193 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:48:40.193 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:48:40.193 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:48:40.193 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T12:48:40.193 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:48:40.195 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:48:40.195 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:48:40.195 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-19T12:48:40.195 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:48:40.195 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:48:40.195 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:48:40.196 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:48:40.212 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:40.211+0000 7fd3c1891a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:40.214 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:40.211+0000 7fd3c1891a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:40.215 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:40.211+0000 7fd3c1891a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:40.410 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:48:40.410 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:48:40.411 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:48:40.411 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:48:40.411 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:48:40.411 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:40.411 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:48:40.412 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:48:40.412 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:40.412 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:40.627 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:40.698 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:40.695+0000 7fd3c1891a40 -1 Falling back to public interface 2026-02-19T12:48:41.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:41.628 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:41.629 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:48:41.629 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:48:41.630 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:41.630 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:41.842 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:42.843 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:42.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:42.844 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:48:42.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:48:42.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:42.844 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:43.059 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:44.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:44.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:44.060 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:48:44.061 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:48:44.061 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:44.061 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:44.274 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:45.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:45.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:45.275 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:48:45.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:48:45.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:45.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:45.488 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:46.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:46.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:46.489 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:48:46.489 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:48:46.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:46.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:46.701 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:47.702 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:47.703 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:48:47.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:47.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:48:47.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:47.704 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:47.777 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:47.775+0000 7fd3c1891a40 -1 osd.2 47 log_to_monitors true 2026-02-19T12:48:47.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:48.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:48.918 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:48.918 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:48:48.919 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:48:48.919 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:48.919 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:48:49.123 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 58 up_thru 58 down_at 48 last_clean_interval [38,47) [v2:127.0.0.1:6818/2553056066,v1:127.0.0.1:6819/2553056066] [v2:127.0.0.1:6820/2553056066,v1:127.0.0.1:6821/2553056066] exists,up 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 2026-02-19T12:48:49.124 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:48:49.124 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:48:49.125 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:48:49.125 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T12:48:49.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid2=116483 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:227: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:48:49.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:48:49.130 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:48:49.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T12:48:49.132 INFO:tasks.workunit.client.0.trial109.stdout:start osd.3 2026-02-19T12:48:49.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T12:48:49.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:48:49.133 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-19T12:48:49.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T12:48:49.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:48:49.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:48:49.133 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:48:49.148 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:49.143+0000 7f2b2dd55a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:49.149 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:49.147+0000 7f2b2dd55a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:49.150 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:49.147+0000 7f2b2dd55a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:49.339 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:49.563 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:49.573 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:49.571+0000 7f2b2dd55a40 -1 Falling back to public interface 2026-02-19T12:48:50.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:50.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:50.564 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:48:50.564 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:48:50.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:50.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:50.774 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:51.775 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:51.776 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:51.776 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:48:51.777 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:48:51.777 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:51.777 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:51.979 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:52.980 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:52.981 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:52.981 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:48:52.981 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:48:52.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:52.982 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:53.184 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:54.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:54.186 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:54.187 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:48:54.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:48:54.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:54.188 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:54.390 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:55.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:55.391 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:55.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:48:55.392 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:48:55.392 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:55.393 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:55.592 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:56.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:56.594 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:56.594 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:48:56.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:48:56.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:56.595 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:56.818 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:48:57.021 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:48:57.019+0000 7f2b2dd55a40 -1 osd.3 49 log_to_monitors true 2026-02-19T12:48:57.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:48:57.820 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:48:57.821 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:48:57.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:48:57.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:48:57.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:48:58.033 INFO:tasks.workunit.client.0.trial109.stdout:osd.3 up in weight 1 up_from 61 up_thru 61 down_at 50 last_clean_interval [42,49) [v2:127.0.0.1:6826/2003431126,v1:127.0.0.1:6827/2003431126] [v2:127.0.0.1:6828/2003431126,v1:127.0.0.1:6829/2003431126] exists,up ee0bd45f-b1cc-425d-a359-7e172d87ae55 2026-02-19T12:48:58.034 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:48:58.034 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:48:58.034 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:48:58.034 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T12:48:58.035 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: osd_pid3=117554 2026-02-19T12:48:58.035 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:231: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T12:48:58.053 INFO:tasks.workunit.client.0.trial109.stdout:hints = 1 2026-02-19T12:48:58.054 INFO:tasks.workunit.client.0.trial109.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T12:48:58.054 INFO:tasks.workunit.client.0.trial109.stdout:Object prefix: benchmark_data_trial109_118605 2026-02-19T12:48:58.054 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:48:58.054 INFO:tasks.workunit.client.0.trial109.stdout: 0 0 0 0 0 0 - 0 2026-02-19T12:48:59.054 INFO:tasks.workunit.client.0.trial109.stdout: 1 16 10839 10823 42.2734 42.2773 0.00188866 0.001476 2026-02-19T12:49:00.054 INFO:tasks.workunit.client.0.trial109.stdout: 2 16 21361 21345 41.6859 41.1016 0.00131368 0.00149716 2026-02-19T12:49:01.054 INFO:tasks.workunit.client.0.trial109.stdout: 3 16 31594 31578 41.1138 39.9727 0.000822566 0.00151821 2026-02-19T12:49:02.054 INFO:tasks.workunit.client.0.trial109.stdout: 4 16 42245 42229 41.2359 41.6055 0.00111755 0.00151387 2026-02-19T12:49:03.054 INFO:tasks.workunit.client.0.trial109.stdout: 5 16 51107 51091 39.9117 34.6172 0.0803511 0.00155329 2026-02-19T12:49:04.054 INFO:tasks.workunit.client.0.trial109.stdout: 6 16 56436 56420 36.7289 20.8164 0.0014489 0.00169988 2026-02-19T12:49:05.054 INFO:tasks.workunit.client.0.trial109.stdout: 7 15 66725 66710 37.2237 40.1953 0.000884401 0.00167725 2026-02-19T12:49:06.054 INFO:tasks.workunit.client.0.trial109.stdout: 8 15 76918 76903 37.5473 39.8164 0.00116142 0.00166292 2026-02-19T12:49:07.054 INFO:tasks.workunit.client.0.trial109.stdout: 9 16 87283 87267 37.8733 40.4844 0.00168299 0.00164858 2026-02-19T12:49:08.054 INFO:tasks.workunit.client.0.trial109.stdout: 10 16 97722 97706 38.1634 40.7773 0.00147461 0.00163608 2026-02-19T12:49:09.054 INFO:tasks.workunit.client.0.trial109.stdout: 11 16 108209 108193 38.4178 40.9648 0.00198226 0.00162527 2026-02-19T12:49:10.055 INFO:tasks.workunit.client.0.trial109.stdout: 12 16 117901 117885 38.371 37.8594 0.00173734 0.00162721 2026-02-19T12:49:11.054 INFO:tasks.workunit.client.0.trial109.stdout: 13 16 127617 127601 38.3387 37.9531 0.00182337 0.00162861 2026-02-19T12:49:12.055 INFO:tasks.workunit.client.0.trial109.stdout: 14 16 137248 137232 38.2872 37.6211 0.00125828 0.00163083 2026-02-19T12:49:13.055 INFO:tasks.workunit.client.0.trial109.stdout: 15 16 147174 147158 38.3194 38.7734 0.00156193 0.00162943 2026-02-19T12:49:14.054 INFO:tasks.workunit.client.0.trial109.stdout: 16 16 155576 155560 37.9756 32.8203 0.0288425 0.001642 2026-02-19T12:49:15.055 INFO:tasks.workunit.client.0.trial109.stdout: 17 16 157548 157532 36.1948 7.70312 0.00141617 0.00172521 2026-02-19T12:49:16.055 INFO:tasks.workunit.client.0.trial109.stdout: 18 16 167261 167245 36.2917 37.9414 0.00130599 0.00172059 2026-02-19T12:49:17.055 INFO:tasks.workunit.client.0.trial109.stdout: 19 15 177027 177012 36.3895 38.1523 0.00193914 0.00171598 2026-02-19T12:49:18.055 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:49:18.055808+0000 min lat: 0.000469271 max lat: 0.16028 avg lat: 0.00171215 2026-02-19T12:49:18.055 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:49:18.055 INFO:tasks.workunit.client.0.trial109.stdout: 20 16 186761 186745 36.4708 38.0195 0.00129204 0.00171215 2026-02-19T12:49:19.055 INFO:tasks.workunit.client.0.trial109.stdout: 21 16 196492 196476 36.544 38.0117 0.0022 0.00170872 2026-02-19T12:49:20.055 INFO:tasks.workunit.client.0.trial109.stdout: 22 16 205923 205907 36.5574 36.8398 0.00140431 0.00170697 2026-02-19T12:49:21.055 INFO:tasks.workunit.client.0.trial109.stdout: 23 16 206117 206101 35.0009 0.757812 0.05118 0.00177862 2026-02-19T12:49:22.055 INFO:tasks.workunit.client.0.trial109.stdout: 24 16 206900 206884 33.6699 3.05859 0.00113745 0.00185469 2026-02-19T12:49:23.055 INFO:tasks.workunit.client.0.trial109.stdout: 25 16 216678 216662 33.8508 38.1953 0.00185183 0.00184481 2026-02-19T12:49:24.056 INFO:tasks.workunit.client.0.trial109.stdout: 26 16 226498 226482 34.0241 38.3594 0.00114567 0.0018354 2026-02-19T12:49:25.056 INFO:tasks.workunit.client.0.trial109.stdout: 27 16 236143 236127 34.1593 37.6758 0.00149176 0.00182814 2026-02-19T12:49:26.056 INFO:tasks.workunit.client.0.trial109.stdout: 28 16 245826 245810 34.2901 37.8242 0.00124401 0.00182115 2026-02-19T12:49:27.056 INFO:tasks.workunit.client.0.trial109.stdout: 29 16 255335 255319 34.3884 37.1445 0.00162142 0.00181597 2026-02-19T12:49:28.056 INFO:tasks.workunit.client.0.trial109.stdout: 30 1 257039 257038 33.4659 6.71484 0.0345439 0.00186599 2026-02-19T12:49:29.056 INFO:tasks.workunit.client.0.trial109.stdout:Total time run: 30.0352 2026-02-19T12:49:29.056 INFO:tasks.workunit.client.0.trial109.stdout:Total writes made: 257039 2026-02-19T12:49:29.056 INFO:tasks.workunit.client.0.trial109.stdout:Write size: 4096 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Object size: 4096 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Bandwidth (MB/sec): 33.4294 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Bandwidth: 12.178 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Max bandwidth (MB/sec): 42.2773 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Min bandwidth (MB/sec): 0.757812 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Average IOPS: 8557 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Stddev IOPS: 3117.58 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Max IOPS: 10823 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Min IOPS: 194 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Average Latency(s): 0.00186616 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Latency(s): 0.00477888 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Max latency(s): 0.172029 2026-02-19T12:49:29.057 INFO:tasks.workunit.client.0.trial109.stdout:Min latency(s): 0.000469271 2026-02-19T12:49:29.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 114316 2026-02-19T12:49:29.060 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2026-02-19T12:49:30.061 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 114316 2026-02-19T12:49:30.061 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (114316) - No such process 2026-02-19T12:49:30.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 0 2026-02-19T12:49:30.264 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:49:30.274 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 115387 2026-02-19T12:49:30.274 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2026-02-19T12:49:31.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 115387 2026-02-19T12:49:31.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (115387) - No such process 2026-02-19T12:49:31.275 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 1 2026-02-19T12:49:31.491 INFO:tasks.workunit.client.0.trial109.stderr:osd.1 is already down. 2026-02-19T12:49:31.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 116483 2026-02-19T12:49:31.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-19T12:49:32.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 116483 2026-02-19T12:49:32.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (116483) - No such process 2026-02-19T12:49:32.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 2 2026-02-19T12:49:32.716 INFO:tasks.workunit.client.0.trial109.stderr:osd.2 is already down. 2026-02-19T12:49:32.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 117554 2026-02-19T12:49:32.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: sleep 1 2026-02-19T12:49:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 117554 2026-02-19T12:49:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 240: kill: (117554) - No such process 2026-02-19T12:49:33.729 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:241: TEST_bluestore: ceph osd down 3 2026-02-19T12:49:33.948 INFO:tasks.workunit.client.0.trial109.stderr:osd.3 is already down. 2026-02-19T12:49:33.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:49:38.716 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:49:38.779 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:246: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2026-02-19T12:49:39.410 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records in 2026-02-19T12:49:39.410 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records out 2026-02-19T12:49:39.410 INFO:tasks.workunit.client.0.trial109.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.630195 s, 1.7 GB/s 2026-02-19T12:49:39.410 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:247: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2026-02-19T12:49:39.423 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:49:44.228 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-19T12:49:44.228 INFO:tasks.workunit.client.0.trial109.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2026-02-19T12:49:44.258 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:252: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:49:49.060 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:49:49.118 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:256: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2026-02-19T12:49:49.439 INFO:tasks.workunit.client.0.trial109.stderr:512+0 records in 2026-02-19T12:49:49.440 INFO:tasks.workunit.client.0.trial109.stderr:512+0 records out 2026-02-19T12:49:49.440 INFO:tasks.workunit.client.0.trial109.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.320592 s, 1.7 GB/s 2026-02-19T12:49:49.440 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:257: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2026-02-19T12:49:49.457 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:49:54.176 INFO:tasks.workunit.client.0.trial109.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-19T12:49:54.176 INFO:tasks.workunit.client.0.trial109.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2026-02-19T12:49:54.208 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2026-02-19T12:49:54.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:263: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:49:59.004 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:49:59.064 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:50:03.836 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:50:03.898 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:268: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2026-02-19T12:50:04.519 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records in 2026-02-19T12:50:04.520 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records out 2026-02-19T12:50:04.520 INFO:tasks.workunit.client.0.trial109.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.620513 s, 1.7 GB/s 2026-02-19T12:50:04.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:269: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2026-02-19T12:50:04.537 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:50:09.716 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-19T12:50:09.716 INFO:tasks.workunit.client.0.trial109.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2026-02-19T12:50:09.716 INFO:tasks.workunit.client.0.trial109.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2026-02-19T12:50:09.750 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2026-02-19T12:50:09.878 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:50:14.564 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:50:14.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:279: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-19T12:50:14.639 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:50:18.920 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-19T12:50:18.957 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2026-02-19T12:50:19.084 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:286: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T12:50:23.760 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:50:23.815 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:289: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2026-02-19T12:50:28.444 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:50:28.506 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:292: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-19T12:50:29.136 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records in 2026-02-19T12:50:29.136 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records out 2026-02-19T12:50:29.137 INFO:tasks.workunit.client.0.trial109.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.629443 s, 1.7 GB/s 2026-02-19T12:50:29.137 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:293: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-19T12:50:29.153 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:50:29.264 INFO:tasks.workunit.client.0.trial109.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2026-02-19T12:50:29.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:299: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-19T12:50:29.266 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:302: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T12:50:33.676 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:50:33.733 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-19T12:50:35.097 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records in 2026-02-19T12:50:35.097 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records out 2026-02-19T12:50:35.098 INFO:tasks.workunit.client.0.trial109.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.21242 s, 886 MB/s 2026-02-19T12:50:35.098 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:307: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-19T12:50:35.115 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:50:39.228 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-19T12:50:39.228 INFO:tasks.workunit.client.0.trial109.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-19T12:50:39.229 INFO:tasks.workunit.client.0.trial109.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2026-02-19T12:50:39.261 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:314: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T12:50:43.540 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:50:43.588 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2026-02-19T12:50:44.204 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records in 2026-02-19T12:50:44.204 INFO:tasks.workunit.client.0.trial109.stderr:1024+0 records out 2026-02-19T12:50:44.205 INFO:tasks.workunit.client.0.trial109.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.615412 s, 1.7 GB/s 2026-02-19T12:50:44.205 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:319: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2026-02-19T12:50:44.222 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:50:49.020 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2026-02-19T12:50:49.021 INFO:tasks.workunit.client.0.trial109.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-19T12:50:49.021 INFO:tasks.workunit.client.0.trial109.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2026-02-19T12:50:49.053 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T12:50:53.428 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:50:53.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:50:53.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:50:53.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:50:53.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:50:53.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:50:53.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:50:53.481 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:50:53.482 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:50:53.483 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:50:53.484 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:50:53.484 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:50:53.485 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:50:53.485 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:50:53.485 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T12:50:53.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:50:53.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:50:53.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:50:53.486 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:50:53.506 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:50:53.504+0000 7f918681fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:50:53.507 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:50:53.504+0000 7f918681fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:50:53.508 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:50:53.508+0000 7f918681fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:50:53.696 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:50:53.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:50:53.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:50:53.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:50:53.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:50:53.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:50:53.697 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:50:53.698 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:50:53.698 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:50:53.698 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:50:53.908 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:50:53.978 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:50:53.976+0000 7f918681fa40 -1 Falling back to public interface 2026-02-19T12:50:54.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:50:54.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:50:54.910 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:50:54.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:50:54.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:50:54.911 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:50:55.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:50:56.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:50:56.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:50:56.129 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:50:56.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:50:56.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:50:56.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:50:56.344 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:50:57.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:50:57.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:50:57.347 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:50:57.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:50:57.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:50:57.347 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:50:57.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:50:58.566 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:50:58.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:50:58.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:50:58.567 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:50:58.568 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:50:58.568 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:50:58.782 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:50:59.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:50:59.783 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:50:59.784 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:50:59.784 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:50:59.784 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:50:59.784 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:50:59.996 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:00.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:00.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:00.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:51:00.997 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:51:00.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:00.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:51:01.212 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:02.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:02.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:02.214 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:51:02.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:51:02.214 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:02.215 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:51:02.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:03.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:03.433 INFO:tasks.workunit.client.0.trial109.stdout:8 2026-02-19T12:51:03.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:03.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T12:51:03.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:03.433 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:51:03.521 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:03.520+0000 7f918681fa40 -1 osd.0 64 log_to_monitors true 2026-02-19T12:51:03.656 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:04.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:04.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:04.658 INFO:tasks.workunit.client.0.trial109.stdout:9 2026-02-19T12:51:04.659 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2026-02-19T12:51:04.659 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:04.659 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:51:04.862 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 72 up_thru 72 down_at 64 last_clean_interval [52,64) [v2:127.0.0.1:6802/1860517966,v1:127.0.0.1:6803/1860517966] [v2:127.0.0.1:6804/1860517966,v1:127.0.0.1:6805/1860517966] exists,up 0e434350-f641-4354-b485-b9c0a1ed7e08 2026-02-19T12:51:04.864 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:51:04.864 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:51:04.864 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:51:04.864 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid0=124781 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:51:04.869 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:51:04.870 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:51:04.871 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:51:04.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:51:04.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T12:51:04.872 INFO:tasks.workunit.client.0.trial109.stdout:start osd.1 2026-02-19T12:51:04.873 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T12:51:04.873 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:51:04.873 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-19T12:51:04.873 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T12:51:04.873 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:51:04.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:51:04.874 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:51:04.886 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:04.884+0000 7fbfaf8f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:04.887 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:04.884+0000 7fbfaf8f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:04.888 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:04.888+0000 7fbfaf8f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:05.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T12:51:05.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:51:05.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T12:51:05.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:51:05.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:51:05.081 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:05.081 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:51:05.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:51:05.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:05.082 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:05.250 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:05.248+0000 7fbfaf8f0a40 -1 Falling back to public interface 2026-02-19T12:51:05.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:06.294 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:06.294 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:06.295 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:51:06.296 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:51:06.296 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:06.297 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:06.500 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:07.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:07.502 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:07.502 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:51:07.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:51:07.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:07.503 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:07.705 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:08.706 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:08.706 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:51:08.707 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:08.707 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:51:08.707 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:08.707 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:08.924 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:09.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:09.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:09.925 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:51:09.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:51:09.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:09.925 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:10.138 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:11.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:11.140 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:51:11.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:11.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:51:11.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:11.140 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:11.352 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:12.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:12.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:12.353 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:51:12.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:51:12.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:12.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:12.569 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:13.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:13.570 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:13.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:51:13.571 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:51:13.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:13.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:13.784 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:14.608 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:14.604+0000 7fbfaf8f0a40 -1 osd.1 65 log_to_monitors true 2026-02-19T12:51:14.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:14.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:14.785 INFO:tasks.workunit.client.0.trial109.stdout:8 2026-02-19T12:51:14.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T12:51:14.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:14.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T12:51:14.996 INFO:tasks.workunit.client.0.trial109.stdout:osd.1 up in weight 1 up_from 75 up_thru 75 down_at 66 last_clean_interval [55,65) [v2:127.0.0.1:6810/2903684035,v1:127.0.0.1:6811/2903684035] [v2:127.0.0.1:6812/2903684035,v1:127.0.0.1:6813/2903684035] exists,up 40ee6289-b175-49f8-8c21-ebd412666ad5 2026-02-19T12:51:14.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:51:14.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:51:14.997 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:51:14.997 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid1=125904 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:51:15.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:51:15.001 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:51:15.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:51:15.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:51:15.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:51:15.004 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T12:51:15.004 INFO:tasks.workunit.client.0.trial109.stdout:start osd.2 2026-02-19T12:51:15.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T12:51:15.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:51:15.005 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-19T12:51:15.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T12:51:15.005 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:51:15.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:51:15.006 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:51:15.025 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:15.024+0000 7efd3af7fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:15.026 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:15.024+0000 7efd3af7fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:15.028 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:15.024+0000 7efd3af7fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:15.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T12:51:15.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:51:15.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T12:51:15.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:51:15.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:51:15.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:15.218 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:51:15.219 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:51:15.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:15.219 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:15.425 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:15.424+0000 7efd3af7fa40 -1 Falling back to public interface 2026-02-19T12:51:15.429 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:16.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:16.431 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:16.432 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:51:16.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:51:16.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:16.432 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:16.646 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:17.647 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:17.648 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:17.648 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:51:17.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:51:17.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:17.649 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:17.859 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:18.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:18.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:18.860 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:51:18.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:51:18.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:18.860 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:19.077 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:20.078 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:20.078 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:20.079 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:51:20.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:51:20.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:20.080 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:20.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:21.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:21.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:21.291 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:51:21.291 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:51:21.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:21.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:21.504 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:22.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:22.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:22.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:51:22.505 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:51:22.505 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:22.506 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:22.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:23.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:23.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:23.727 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:51:23.727 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:51:23.728 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:23.728 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:23.944 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:24.104 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:24.104+0000 7efd3af7fa40 -1 osd.2 67 log_to_monitors true 2026-02-19T12:51:24.945 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:24.945 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:24.946 INFO:tasks.workunit.client.0.trial109.stdout:8 2026-02-19T12:51:24.947 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T12:51:24.947 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:24.947 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T12:51:25.155 INFO:tasks.workunit.client.0.trial109.stdout:osd.2 up in weight 1 up_from 78 up_thru 78 down_at 68 last_clean_interval [58,67) [v2:127.0.0.1:6818/2334343849,v1:127.0.0.1:6819/2334343849] [v2:127.0.0.1:6820/2334343849,v1:127.0.0.1:6821/2334343849] exists,up 0bf97bc7-65a2-4d4e-81aa-61efdca6b6a9 2026-02-19T12:51:25.156 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:51:25.156 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:51:25.156 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:51:25.156 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid2=126990 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:333: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-19T12:51:25.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:51:25.161 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:51:25.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:51:25.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:51:25.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:51:25.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:51:25.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T12:51:25.163 INFO:tasks.workunit.client.0.trial109.stdout:start osd.3 2026-02-19T12:51:25.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T12:51:25.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:51:25.165 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-19T12:51:25.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T12:51:25.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:51:25.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:51:25.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:51:25.180 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:25.180+0000 7fd71507ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:25.181 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:25.180+0000 7fd71507ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:25.182 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:25.180+0000 7fd71507ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:51:25.374 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T12:51:25.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:51:25.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T12:51:25.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:51:25.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:51:25.375 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:25.375 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:51:25.376 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:51:25.376 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:25.376 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:25.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:25.597 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:25.596+0000 7fd71507ba40 -1 Falling back to public interface 2026-02-19T12:51:26.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:26.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:26.582 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:51:26.583 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:51:26.583 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:26.584 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:26.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:27.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:27.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:27.788 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:51:27.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:51:27.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:27.788 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:27.992 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:28.994 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:28.994 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:28.994 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:51:28.995 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:51:28.995 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:28.995 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:29.197 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:30.198 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:30.198 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:30.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:51:30.199 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:51:30.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:30.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:30.401 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:31.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:31.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:31.402 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:51:31.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:51:31.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:31.402 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:31.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:32.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:32.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:32.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:51:32.610 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:51:32.611 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:32.611 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:32.827 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:33.829 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:33.829 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:33.829 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:51:33.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:51:33.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:33.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:34.035 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:51:34.925 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:51:34.924+0000 7fd71507ba40 -1 osd.3 69 log_to_monitors true 2026-02-19T12:51:35.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:51:35.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:51:35.037 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T12:51:35.038 INFO:tasks.workunit.client.0.trial109.stdout:8 2026-02-19T12:51:35.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:51:35.038 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T12:51:35.253 INFO:tasks.workunit.client.0.trial109.stdout:osd.3 up in weight 1 up_from 81 up_thru 81 down_at 70 last_clean_interval [61,69) [v2:127.0.0.1:6826/1439667122,v1:127.0.0.1:6827/1439667122] [v2:127.0.0.1:6828/1439667122,v1:127.0.0.1:6829/1439667122] exists,up ee0bd45f-b1cc-425d-a359-7e172d87ae55 2026-02-19T12:51:35.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:51:35.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:51:35.254 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:51:35.254 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T12:51:35.255 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: osd_pid3=128081 2026-02-19T12:51:35.255 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T12:51:35.278 INFO:tasks.workunit.client.0.trial109.stdout:hints = 1 2026-02-19T12:51:35.279 INFO:tasks.workunit.client.0.trial109.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T12:51:35.279 INFO:tasks.workunit.client.0.trial109.stdout:Object prefix: benchmark_data_trial109_129157 2026-02-19T12:51:35.279 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:51:35.279 INFO:tasks.workunit.client.0.trial109.stdout: 0 0 0 0 0 0 - 0 2026-02-19T12:51:36.279 INFO:tasks.workunit.client.0.trial109.stdout: 1 16 10874 10858 42.4105 42.4141 0.00108956 0.00147122 2026-02-19T12:51:37.279 INFO:tasks.workunit.client.0.trial109.stdout: 2 15 22113 22098 43.1567 43.9062 0.00136703 0.00144638 2026-02-19T12:51:38.279 INFO:tasks.workunit.client.0.trial109.stdout: 3 15 32655 32640 42.4966 41.1797 0.00124905 0.00146887 2026-02-19T12:51:39.279 INFO:tasks.workunit.client.0.trial109.stdout: 4 16 42969 42953 41.943 40.2852 0.00116632 0.00148824 2026-02-19T12:51:40.279 INFO:tasks.workunit.client.0.trial109.stdout: 5 16 47681 47665 37.2354 18.4062 0.001508 0.00167679 2026-02-19T12:51:41.279 INFO:tasks.workunit.client.0.trial109.stdout: 6 15 58297 58282 37.9411 41.4727 0.00113109 0.00164561 2026-02-19T12:51:42.279 INFO:tasks.workunit.client.0.trial109.stdout: 7 16 69175 69159 38.5902 42.4883 0.00114941 0.00161795 2026-02-19T12:51:43.279 INFO:tasks.workunit.client.0.trial109.stdout: 8 16 79592 79576 38.8525 40.6914 0.00140119 0.00160697 2026-02-19T12:51:44.280 INFO:tasks.workunit.client.0.trial109.stdout: 9 16 90160 90144 39.1221 41.2812 0.00111363 0.00159592 2026-02-19T12:51:45.279 INFO:tasks.workunit.client.0.trial109.stdout: 10 15 100842 100827 39.3825 41.7305 0.00116909 0.00158543 2026-02-19T12:51:46.279 INFO:tasks.workunit.client.0.trial109.stdout: 11 16 111353 111337 39.5342 41.0547 0.00115362 0.00157933 2026-02-19T12:51:47.280 INFO:tasks.workunit.client.0.trial109.stdout: 12 15 121822 121807 39.6477 40.8984 0.00099654 0.00157482 2026-02-19T12:51:48.280 INFO:tasks.workunit.client.0.trial109.stdout: 13 16 131916 131900 39.6304 39.4258 0.00149816 0.00157551 2026-02-19T12:51:49.280 INFO:tasks.workunit.client.0.trial109.stdout: 14 16 141996 141980 39.6119 39.375 0.000890253 0.00157617 2026-02-19T12:51:50.280 INFO:tasks.workunit.client.0.trial109.stdout: 15 16 149877 149861 39.0233 30.7852 0.0247319 0.00159664 2026-02-19T12:51:51.280 INFO:tasks.workunit.client.0.trial109.stdout: 16 16 153025 153009 37.3529 12.2969 0.00142259 0.0016717 2026-02-19T12:51:52.280 INFO:tasks.workunit.client.0.trial109.stdout: 17 16 162976 162960 37.442 38.8711 0.00122712 0.0016677 2026-02-19T12:51:53.280 INFO:tasks.workunit.client.0.trial109.stdout: 18 16 172808 172792 37.4954 38.4062 0.00140064 0.00166536 2026-02-19T12:51:54.280 INFO:tasks.workunit.client.0.trial109.stdout: 19 16 182902 182886 37.597 39.4297 0.00124854 0.00166084 2026-02-19T12:51:55.280 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:51:55.281183+0000 min lat: 0.000567072 max lat: 0.134999 avg lat: 0.00165758 2026-02-19T12:51:55.280 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:51:55.281 INFO:tasks.workunit.client.0.trial109.stdout: 20 16 192904 192888 37.6705 39.0703 0.0012096 0.00165758 2026-02-19T12:51:56.280 INFO:tasks.workunit.client.0.trial109.stdout: 21 16 202086 202070 37.5845 35.8672 0.0197825 0.0016555 2026-02-19T12:51:57.280 INFO:tasks.workunit.client.0.trial109.stdout: 22 16 202157 202141 35.8887 0.277344 0.745098 0.00172967 2026-02-19T12:51:58.280 INFO:tasks.workunit.client.0.trial109.stdout: 23 16 202345 202329 34.3603 0.734375 0.0344522 0.00181455 2026-02-19T12:51:59.280 INFO:tasks.workunit.client.0.trial109.stdout: 24 16 202751 202735 32.9947 1.58594 0.00347504 0.00189268 2026-02-19T12:52:00.281 INFO:tasks.workunit.client.0.trial109.stdout: 25 16 212724 212708 33.233 38.957 0.00104525 0.00187913 2026-02-19T12:52:01.281 INFO:tasks.workunit.client.0.trial109.stdout: 26 16 222678 222662 33.4502 38.8828 0.00179638 0.00186694 2026-02-19T12:52:02.281 INFO:tasks.workunit.client.0.trial109.stdout: 27 16 232664 232648 33.656 39.0078 0.00124029 0.00185547 2026-02-19T12:52:03.281 INFO:tasks.workunit.client.0.trial109.stdout: 28 16 242528 242512 33.83 38.5312 0.00163804 0.00184594 2026-02-19T12:52:04.281 INFO:tasks.workunit.client.0.trial109.stdout: 29 16 252535 252519 34.0112 39.0898 0.00479819 0.00183607 2026-02-19T12:52:05.281 INFO:tasks.workunit.client.0.trial109.stdout:Total time run: 30.0013 2026-02-19T12:52:05.281 INFO:tasks.workunit.client.0.trial109.stdout:Total writes made: 262085 2026-02-19T12:52:05.281 INFO:tasks.workunit.client.0.trial109.stdout:Write size: 4096 2026-02-19T12:52:05.281 INFO:tasks.workunit.client.0.trial109.stdout:Object size: 4096 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Bandwidth (MB/sec): 34.1241 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Bandwidth: 13.2852 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Max bandwidth (MB/sec): 43.9062 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Min bandwidth (MB/sec): 0.277344 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Average IOPS: 8735 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Stddev IOPS: 3401 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Max IOPS: 11240 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Min IOPS: 71 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Average Latency(s): 0.00183007 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Latency(s): 0.00720138 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Max latency(s): 0.745171 2026-02-19T12:52:05.282 INFO:tasks.workunit.client.0.trial109.stdout:Min latency(s): 0.000567072 2026-02-19T12:52:05.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:339: TEST_bluestore: wait_for_clean 2026-02-19T12:52:05.285 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:52:05.285 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:52:05.285 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:52:05.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:52:05.286 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:52:05.286 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:52:05.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:52:05.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:52:05.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:52:05.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:52:05.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:52:05.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:52:05.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:52:05.382 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:52:05.383 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:52:05.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T12:52:05.593 INFO:tasks.workunit.client.0.trial109.stderr:1 2026-02-19T12:52:05.593 INFO:tasks.workunit.client.0.trial109.stderr:2 2026-02-19T12:52:05.593 INFO:tasks.workunit.client.0.trial109.stderr:3' 2026-02-19T12:52:05.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:52:05.593 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:52:05.594 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:52:05.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645327 2026-02-19T12:52:05.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645327 2026-02-19T12:52:05.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-309237645327' 2026-02-19T12:52:05.674 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:52:05.674 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-19T12:52:05.754 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=322122547213 2026-02-19T12:52:05.755 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 322122547213 2026-02-19T12:52:05.755 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-309237645327 1-322122547213' 2026-02-19T12:52:05.755 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:52:05.755 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-19T12:52:05.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449099 2026-02-19T12:52:05.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449099 2026-02-19T12:52:05.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-309237645327 1-322122547213 2-335007449099' 2026-02-19T12:52:05.833 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:52:05.834 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-19T12:52:05.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350985 2026-02-19T12:52:05.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350985 2026-02-19T12:52:05.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-309237645327 1-322122547213 2-335007449099 3-347892350985' 2026-02-19T12:52:05.913 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:52:05.914 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-309237645327 2026-02-19T12:52:05.914 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:52:05.915 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:52:05.915 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-309237645327 2026-02-19T12:52:05.916 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:52:05.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=309237645327 2026-02-19T12:52:05.917 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 309237645327 2026-02-19T12:52:05.917 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 309237645327' 2026-02-19T12:52:05.917 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:52:06.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 309237645327 -lt 309237645327 2026-02-19T12:52:06.127 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:52:06.128 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-322122547213 2026-02-19T12:52:06.128 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:52:06.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-19T12:52:06.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-322122547213 2026-02-19T12:52:06.130 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:52:06.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=322122547213 2026-02-19T12:52:06.131 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.1 seq 322122547213 2026-02-19T12:52:06.132 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 322122547213' 2026-02-19T12:52:06.132 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:52:06.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 322122547211 -lt 322122547213 2026-02-19T12:52:06.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:52:07.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:52:07.355 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:52:07.565 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 322122547211 -lt 322122547213 2026-02-19T12:52:07.566 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:52:08.567 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:52:08.567 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T12:52:08.785 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 322122547213 -lt 322122547213 2026-02-19T12:52:08.786 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:52:08.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-335007449099 2026-02-19T12:52:08.786 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:52:08.787 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-19T12:52:08.788 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-335007449099 2026-02-19T12:52:08.788 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:52:08.790 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=335007449099 2026-02-19T12:52:08.790 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 335007449099' 2026-02-19T12:52:08.790 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.2 seq 335007449099 2026-02-19T12:52:08.791 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T12:52:08.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 335007449099 -lt 335007449099 2026-02-19T12:52:08.998 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:52:08.999 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-347892350985 2026-02-19T12:52:08.999 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:52:09.000 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-19T12:52:09.001 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-347892350985 2026-02-19T12:52:09.001 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:52:09.002 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350985 2026-02-19T12:52:09.003 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.3 seq 347892350985 2026-02-19T12:52:09.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 347892350985' 2026-02-19T12:52:09.003 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-19T12:52:09.221 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350985 -lt 347892350985 2026-02-19T12:52:09.222 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:52:09.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:52:09.223 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:52:09.497 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T12:52:09.498 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:52:09.498 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:52:09.498 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:52:09.498 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:52:09.498 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:52:09.498 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:52:09.498 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:52:09.699 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T12:52:09.700 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:52:09.701 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:52:09.701 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:52:09.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T12:52:09.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:52:09.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:52:09.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-19T12:52:09.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:09.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:52:09.971 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T12:52:09.973 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:52:09.973 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:52:09.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:52:09.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:52:09.973 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:52:10.282 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:52:10.282 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:52:10.284 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:52:10.284 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:52:10.286 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:52:10.286 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:52:10.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:52:10.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:52:10.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:52:10.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:52:10.289 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:52:10.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:52:10.291 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:52:10.291 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T12:52:16.277 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:52:16.277 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.278 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.278 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83893 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:52:16.279 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:52:16.280 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:52:16.280 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:52:16.280 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:52:16.282 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:52:16.283 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:52:16.283 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:52:16.284 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:52:16.285 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:52:16.286 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:52:16.286 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:52:16.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:52:16.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:52:16.287 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:52:16.287 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:52:16.288 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:52:16.289 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:52:16.290 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T12:52:16.291 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:52:16.291 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.291 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.292 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83893 2026-02-19T12:52:16.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:52:16.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:52:16.293 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-19T12:52:16.294 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:52:16.294 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.294 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.294 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83893 2026-02-19T12:52:16.296 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:52:16.297 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T12:52:16.297 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:52:16.297 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-19T12:52:16.297 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore2 td/osd-bluefs-volume-ops 2026-02-19T12:52:16.297 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:343: TEST_bluestore2: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:16.297 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: ulimit -n 2026-02-19T12:52:16.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: local flimit=4096 2026-02-19T12:52:16.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:346: TEST_bluestore2: '[' 4096 -lt 1536 ']' 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: export CEPH_MON=127.0.0.1:7146 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: CEPH_MON=127.0.0.1:7146 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:350: TEST_bluestore2: export CEPH_ARGS 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: uuidgen 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: CEPH_ARGS+='--fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none ' 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:352: TEST_bluestore2: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:353: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:354: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:355: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:356: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-19T12:52:16.300 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:357: TEST_bluestore2: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:358: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:359: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:360: TEST_bluestore2: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:362: TEST_bluestore2: run_mon td/osd-bluefs-volume-ops a 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-19T12:52:16.301 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:52:16.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:52:16.355 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:52:16.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:52:16.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:52:16.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:52:16.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:52:16.357 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:52:16.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:52:16.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:52:16.358 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:52:16.359 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:52:16.359 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.359 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.359 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83893/ceph-mon.a.asok 2026-02-19T12:52:16.359 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:52:16.359 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83893/ceph-mon.a.asok config get fsid 2026-02-19T12:52:16.414 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:52:16.414 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:52:16.414 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:52:16.414 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:52:16.415 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:52:16.416 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:52:16.416 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:52:16.416 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:52:16.416 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:52:16.416 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.416 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.417 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83893/ceph-mon.a.asok 2026-02-19T12:52:16.417 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:52:16.417 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83893/ceph-mon.a.asok config get mon_host 2026-02-19T12:52:16.470 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:363: TEST_bluestore2: run_mgr td/osd-bluefs-volume-ops x 2026-02-19T12:52:16.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:16.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:52:16.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:52:16.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:52:16.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-19T12:52:16.471 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:52:16.583 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:52:16.583 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:52:16.583 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:52:16.583 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:52:16.584 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.584 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.584 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:52:16.584 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:52:16.584 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:52:16.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:364: TEST_bluestore2: run_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:52:16.607 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:52:16.608 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:52:16.609 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:52:16.610 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:52:16.611 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:52:16.611 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=16cfff88-091e-4fd5-b529-dcaf886cf701 2026-02-19T12:52:16.611 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 16cfff88-091e-4fd5-b529-dcaf886cf701 2026-02-19T12:52:16.612 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 16cfff88-091e-4fd5-b529-dcaf886cf701' 2026-02-19T12:52:16.612 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:52:16.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCAB5dpiYYaJRAAthQkXN/2Zu7SgSoxzoeVnw== 2026-02-19T12:52:16.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCAB5dpiYYaJRAAthQkXN/2Zu7SgSoxzoeVnw=="}' 2026-02-19T12:52:16.623 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 16cfff88-091e-4fd5-b529-dcaf886cf701 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-19T12:52:16.740 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:52:16.748 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-19T12:52:16.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCAB5dpiYYaJRAAthQkXN/2Zu7SgSoxzoeVnw== --osd-uuid 16cfff88-091e-4fd5-b529-dcaf886cf701 2026-02-19T12:52:16.768 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:16.763+0000 7f87530e8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:16.769 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:16.767+0000 7f87530e8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:16.770 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:16.767+0000 7f87530e8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:16.771 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:16.767+0000 7f87530e8a40 -1 bdev(0x559e82cfcc00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:52:16.771 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:16.767+0000 7f87530e8a40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-19T12:52:18.107 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-19T12:52:18.107 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:52:18.108 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:52:18.108 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:52:18.109 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:52:18.394 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:52:18.395 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:52:18.395 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:52:18.396 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:52:18.396 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:52:18.396 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:52:18.422 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:18.419+0000 7fbda1c9da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:18.424 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:18.423+0000 7fbda1c9da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:18.425 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:18.423+0000 7fbda1c9da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:18.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:52:18.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:52:18.613 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:52:18.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:52:18.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:52:18.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:52:18.614 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:52:18.614 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:52:18.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:52:18.615 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:52:18.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:52:18.841 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:18.839+0000 7fbda1c9da40 -1 Falling back to public interface 2026-02-19T12:52:19.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:52:19.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:52:19.826 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:52:19.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:52:19.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:52:19.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:52:19.855 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:19.851+0000 7fbda1c9da40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:52:20.042 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:52:21.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:52:21.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:52:21.044 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:52:21.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:52:21.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:52:21.044 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:52:21.270 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1794521770,v1:127.0.0.1:6803/1794521770] [v2:127.0.0.1:6804/1794521770,v1:127.0.0.1:6805/1794521770] exists,up 16cfff88-091e-4fd5-b529-dcaf886cf701 2026-02-19T12:52:21.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:52:21.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:52:21.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:52:21.270 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:52:21.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: osd_pid0=131103 2026-02-19T12:52:21.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:367: TEST_bluestore2: sleep 5 2026-02-19T12:52:26.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:368: TEST_bluestore2: create_pool foo 16 2026-02-19T12:52:26.273 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-19T12:52:26.545 INFO:tasks.workunit.client.0.trial109.stderr:pool 'foo' already exists 2026-02-19T12:52:26.556 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:52:27.557 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:370: TEST_bluestore2: retry = 0 2026-02-19T12:52:27.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 370: retry: command not found 2026-02-19T12:52:27.558 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:371: TEST_bluestore2: [[ '' -le 5 ]] 2026-02-19T12:52:27.559 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:373: TEST_bluestore2: timeout 60 rados bench -p foo 10 write --write-omap --no-cleanup 2026-02-19T12:52:27.580 INFO:tasks.workunit.client.0.trial109.stdout:hints = 1 2026-02-19T12:52:27.581 INFO:tasks.workunit.client.0.trial109.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects 2026-02-19T12:52:27.581 INFO:tasks.workunit.client.0.trial109.stdout:Object prefix: benchmark_data_trial109_133781 2026-02-19T12:52:27.627 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:52:27.627 INFO:tasks.workunit.client.0.trial109.stdout: 0 0 0 0 0 0 - 0 2026-02-19T12:52:28.627 INFO:tasks.workunit.client.0.trial109.stdout: 1 16 179 163 651.946 652 0.0823144 0.0926216 2026-02-19T12:52:29.628 INFO:tasks.workunit.client.0.trial109.stdout: 2 16 380 364 727.935 804 0.0772833 0.0869265 2026-02-19T12:52:30.627 INFO:tasks.workunit.client.0.trial109.stdout: 3 16 563 547 729.257 732 0.0791451 0.0870077 2026-02-19T12:52:31.628 INFO:tasks.workunit.client.0.trial109.stdout: 4 16 739 723 722.92 704 0.0874077 0.0871506 2026-02-19T12:52:32.628 INFO:tasks.workunit.client.0.trial109.stdout: 5 16 940 924 739.123 804 0.0874449 0.0859047 2026-02-19T12:52:33.628 INFO:tasks.workunit.client.0.trial109.stdout: 6 16 1123 1107 737.923 732 0.0785981 0.0863524 2026-02-19T12:52:34.628 INFO:tasks.workunit.client.0.trial109.stdout: 7 16 1292 1276 729.067 676 0.100975 0.087102 2026-02-19T12:52:35.628 INFO:tasks.workunit.client.0.trial109.stdout: 8 16 1484 1468 733.925 768 0.0910465 0.0866659 2026-02-19T12:52:36.628 INFO:tasks.workunit.client.0.trial109.stdout: 9 16 1683 1667 740.815 796 0.0752798 0.0860226 2026-02-19T12:52:37.629 INFO:tasks.workunit.client.0.trial109.stdout: 10 16 1868 1852 740.726 740 0.0744587 0.0860985 2026-02-19T12:52:38.629 INFO:tasks.workunit.client.0.trial109.stdout:Total time run: 10.0672 2026-02-19T12:52:38.629 INFO:tasks.workunit.client.0.trial109.stdout:Total writes made: 1868 2026-02-19T12:52:38.629 INFO:tasks.workunit.client.0.trial109.stdout:Write size: 4194304 2026-02-19T12:52:38.629 INFO:tasks.workunit.client.0.trial109.stdout:Object size: 4194304 2026-02-19T12:52:38.629 INFO:tasks.workunit.client.0.trial109.stdout:Bandwidth (MB/sec): 742.213 2026-02-19T12:52:38.629 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Bandwidth: 53.0928 2026-02-19T12:52:38.629 INFO:tasks.workunit.client.0.trial109.stdout:Max bandwidth (MB/sec): 804 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Min bandwidth (MB/sec): 652 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Average IOPS: 185 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Stddev IOPS: 13.2732 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Max IOPS: 201 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Min IOPS: 163 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Average Latency(s): 0.0860725 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Latency(s): 0.0100874 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Max latency(s): 0.136086 2026-02-19T12:52:38.630 INFO:tasks.workunit.client.0.trial109.stdout:Min latency(s): 0.0295504 2026-02-19T12:52:38.640 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:376: TEST_bluestore2: sleep 10 2026-02-19T12:52:48.643 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-19T12:52:48.643 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: jq .bluefs.db_used_bytes 2026-02-19T12:52:48.726 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: db_used=462422016 2026-02-19T12:52:48.727 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-19T12:52:48.727 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: jq .bluefs.slow_used_bytes 2026-02-19T12:52:48.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: spilled_over=166264832 2026-02-19T12:52:48.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:380: TEST_bluestore2: (( retry+=1 )) 2026-02-19T12:52:48.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: test 166264832 -eq 0 2026-02-19T12:52:48.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: break 2026-02-19T12:52:48.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:383: TEST_bluestore2: test 166264832 -gt 0 2026-02-19T12:52:48.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 131103 2026-02-19T12:52:48.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: sleep 1 2026-02-19T12:52:49.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 131103 2026-02-19T12:52:49.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 385: kill: (131103) - No such process 2026-02-19T12:52:49.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:386: TEST_bluestore2: ceph osd down 0 2026-02-19T12:52:50.021 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:52:50.031 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:388: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/block --command bluefs-bdev-migrate 2026-02-19T12:52:50.051 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:52:51.380 INFO:tasks.workunit.client.0.trial109.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-19T12:52:51.399 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:393: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command bluefs-bdev-sizes 2026-02-19T12:52:51.418 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:52:51.812 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x100000000(4 GiB) : using 0x24f98000(592 MiB) 2026-02-19T12:52:51.899 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:396: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command fsck 2026-02-19T12:52:53.572 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:52:53.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:399: TEST_bluestore2: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:52:53.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:52:53.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:52:53.653 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:52:53.654 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:52:53.655 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:52:53.656 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:52:53.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:52:53.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:52:53.657 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T12:52:53.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:52:53.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:52:53.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:52:53.657 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:52:53.677 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:53.674+0000 7f8154ca9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:53.678 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:53.674+0000 7f8154ca9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:53.679 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:53.674+0000 7f8154ca9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:52:53.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:52:53.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:52:53.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:52:53.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:52:53.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:52:53.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:52:53.872 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:52:53.873 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:52:53.873 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:52:53.873 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:52:54.078 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:52:54.122 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:54.118+0000 7f8154ca9a40 -1 Falling back to public interface 2026-02-19T12:52:55.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:52:55.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:52:55.079 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:52:55.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:52:55.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:52:55.079 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:52:55.297 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:52:56.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:52:56.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:52:56.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:52:56.299 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:52:56.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:52:56.299 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:52:56.518 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:52:56.732 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:52:56.726+0000 7f8154ca9a40 -1 osd.0 9 log_to_monitors true 2026-02-19T12:52:57.519 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:52:57.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:52:57.520 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:52:57.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:52:57.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:52:57.520 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:52:57.744 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 12 up_thru 12 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6802/1253665361,v1:127.0.0.1:6803/1253665361] [v2:127.0.0.1:6804/1253665361,v1:127.0.0.1:6805/1253665361] exists,up 16cfff88-091e-4fd5-b529-dcaf886cf701 2026-02-19T12:52:57.745 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:52:57.745 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:52:57.745 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:52:57.745 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:52:57.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: osd_pid0=135012 2026-02-19T12:52:57.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:402: TEST_bluestore2: wait_for_clean 2026-02-19T12:52:57.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:52:57.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:52:57.747 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:52:57.747 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:52:57.747 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:52:57.748 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:52:57.748 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:52:57.748 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:52:57.748 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:52:57.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:52:57.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:52:57.853 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:52:57.854 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:52:57.854 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:52:57.854 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:52:58.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-19T12:52:58.062 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:52:58.063 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:52:58.063 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:52:58.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607555 2026-02-19T12:52:58.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607555 2026-02-19T12:52:58.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-51539607555' 2026-02-19T12:52:58.146 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:52:58.147 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-51539607555 2026-02-19T12:52:58.147 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:52:58.147 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:52:58.148 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-51539607555 2026-02-19T12:52:58.148 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:52:58.150 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607555 2026-02-19T12:52:58.150 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-19T12:52:58.150 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 51539607555 2026-02-19T12:52:58.150 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:52:58.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 51539607555 2026-02-19T12:52:58.369 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:52:59.370 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:52:59.371 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:52:59.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-19T12:52:59.581 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:52:59.581 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:52:59.582 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:52:59.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T12:52:59.862 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:52:59.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:52:59.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:52:59.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:52:59.862 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:52:59.863 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:52:59.863 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:53:00.070 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T12:53:00.070 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:53:00.070 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:53:00.071 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:53:00.353 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:53:00.354 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:53:00.461 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:53:00.461 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:53:00.462 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:53:00.463 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:53:00.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:53:00.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:53:00.464 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:53:00.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:53:00.466 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:53:00.466 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:53:00.466 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:53:00.467 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:53:00.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:53:00.469 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T12:53:00.803 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:53:00.803 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:00.803 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:00.803 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83893 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T12:53:00.805 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T12:53:00.806 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:53:00.806 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:53:00.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:53:00.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:53:00.806 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:53:00.807 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:53:00.807 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:53:00.808 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:53:00.809 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:53:00.810 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:53:00.810 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:53:00.810 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:53:00.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:53:00.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:53:00.812 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:53:00.812 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:53:00.813 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:53:00.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T12:53:00.814 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T12:53:00.816 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:53:00.816 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:00.816 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:00.816 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83893 2026-02-19T12:53:00.817 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:53:00.817 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:53:00.817 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-19T12:53:00.819 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T12:53:00.819 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:00.819 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:00.819 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83893 2026-02-19T12:53:00.820 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T12:53:00.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T12:53:00.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T12:53:00.821 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-19T12:53:00.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore_expand td/osd-bluefs-volume-ops 2026-02-19T12:53:00.822 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:406: TEST_bluestore_expand: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:00.822 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: ulimit -n 2026-02-19T12:53:00.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: local flimit=4096 2026-02-19T12:53:00.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:409: TEST_bluestore_expand: '[' 4096 -lt 1536 ']' 2026-02-19T12:53:00.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: export CEPH_MON=127.0.0.1:7146 2026-02-19T12:53:00.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: CEPH_MON=127.0.0.1:7146 2026-02-19T12:53:00.823 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:413: TEST_bluestore_expand: export CEPH_ARGS 2026-02-19T12:53:00.823 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: uuidgen 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: CEPH_ARGS+='--fsid=18f185c5-8817-4e35-bb2b-57f87705679c --auth-supported=none ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:415: TEST_bluestore_expand: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:416: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:417: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:418: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:419: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:420: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:421: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-19T12:53:00.825 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:422: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:423: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:425: TEST_bluestore_expand: run_mon td/osd-bluefs-volume-ops a 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-19T12:53:00.826 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:00.849 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T12:53:00.849 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:53:00.849 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:53:00.849 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:53:00.849 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:00.849 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:00.850 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:53:00.850 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T12:53:00.882 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T12:53:00.883 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T12:53:00.883 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:53:00.883 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:53:00.883 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T12:53:00.884 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83893/ceph-mon.a.asok 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:53:00.885 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83893/ceph-mon.a.asok config get fsid 2026-02-19T12:53:00.958 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T12:53:00.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T12:53:00.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T12:53:00.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T12:53:00.959 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T12:53:00.959 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T12:53:00.959 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T12:53:00.959 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T12:53:00.960 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T12:53:00.960 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:00.960 INFO:tasks.workunit.client.0.trial109.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:00.960 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83893/ceph-mon.a.asok 2026-02-19T12:53:00.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T12:53:00.960 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83893/ceph-mon.a.asok config get mon_host 2026-02-19T12:53:01.015 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:426: TEST_bluestore_expand: run_mgr td/osd-bluefs-volume-ops x 2026-02-19T12:53:01.015 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:01.015 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T12:53:01.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T12:53:01.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T12:53:01.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-19T12:53:01.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T12:53:01.139 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T12:53:01.139 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:53:01.139 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:53:01.139 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:53:01.139 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:01.139 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:01.140 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:53:01.140 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:53:01.142 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:427: TEST_bluestore_expand: run_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=18f185c5-8817-4e35-bb2b-57f87705679c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:53:01.162 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:53:01.163 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:53:01.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:53:01.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:53:01.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T12:53:01.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T12:53:01.164 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:53:01.164 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T12:53:01.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=38c6b7c3-07fc-4daf-82f2-620b9d97d152 2026-02-19T12:53:01.165 INFO:tasks.workunit.client.0.trial109.stdout:add osd0 38c6b7c3-07fc-4daf-82f2-620b9d97d152 2026-02-19T12:53:01.165 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 38c6b7c3-07fc-4daf-82f2-620b9d97d152' 2026-02-19T12:53:01.165 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T12:53:01.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCtB5dpAu7JChAAQLhGz98deGuLpYc5G+Ysjg== 2026-02-19T12:53:01.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCtB5dpAu7JChAAQLhGz98deGuLpYc5G+Ysjg=="}' 2026-02-19T12:53:01.181 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 38c6b7c3-07fc-4daf-82f2-620b9d97d152 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-19T12:53:01.300 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:53:01.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-19T12:53:01.310 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=18f185c5-8817-4e35-bb2b-57f87705679c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCtB5dpAu7JChAAQLhGz98deGuLpYc5G+Ysjg== --osd-uuid 38c6b7c3-07fc-4daf-82f2-620b9d97d152 2026-02-19T12:53:01.332 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:01.326+0000 7f56450eba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:53:01.333 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:01.330+0000 7f56450eba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:53:01.334 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:01.330+0000 7f56450eba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:53:01.334 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:01.330+0000 7f56450eba40 -1 bdev(0x5635f448ac00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-19T12:53:01.334 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:01.330+0000 7f56450eba40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-19T12:53:02.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-19T12:53:02.660 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T12:53:02.661 INFO:tasks.workunit.client.0.trial109.stdout:adding osd0 key to auth repository 2026-02-19T12:53:02.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T12:53:02.661 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T12:53:02.957 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:53:02.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T12:53:02.958 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T12:53:02.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=18f185c5-8817-4e35-bb2b-57f87705679c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:53:02.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T12:53:02.959 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T12:53:02.980 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:02.978+0000 7f2bce9c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:53:02.982 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:02.978+0000 7f2bce9c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:53:02.983 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:02.978+0000 7f2bce9c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:53:03.182 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T12:53:03.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:53:03.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:53:03.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:53:03.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:53:03.183 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:53:03.184 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:53:03.184 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:53:03.184 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:53:03.184 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:53:03.377 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:03.374+0000 7f2bce9c7a40 -1 Falling back to public interface 2026-02-19T12:53:03.398 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:53:04.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:53:04.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:53:04.400 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:53:04.401 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:53:04.401 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:53:04.401 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:53:04.403 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:53:04.398+0000 7f2bce9c7a40 -1 osd.0 0 log_to_monitors true 2026-02-19T12:53:04.617 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:53:05.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:53:05.619 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:53:05.619 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:53:05.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:53:05.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:53:05.620 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:53:05.834 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2831147683,v1:127.0.0.1:6803/2831147683] [v2:127.0.0.1:6804/2831147683,v1:127.0.0.1:6805/2831147683] exists,up 38c6b7c3-07fc-4daf-82f2-620b9d97d152 2026-02-19T12:53:05.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:53:05.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:53:05.835 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:53:05.835 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:53:05.836 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: osd_pid0=137671 2026-02-19T12:53:05.836 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:430: TEST_bluestore_expand: sleep 5 2026-02-19T12:53:10.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:431: TEST_bluestore_expand: create_pool foo 16 2026-02-19T12:53:10.837 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-19T12:53:11.109 INFO:tasks.workunit.client.0.trial109.stderr:pool 'foo' already exists 2026-02-19T12:53:11.119 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T12:53:12.121 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:434: TEST_bluestore_expand: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T12:53:12.145 INFO:tasks.workunit.client.0.trial109.stdout:hints = 1 2026-02-19T12:53:12.145 INFO:tasks.workunit.client.0.trial109.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T12:53:12.145 INFO:tasks.workunit.client.0.trial109.stdout:Object prefix: benchmark_data_trial109_140144 2026-02-19T12:53:12.146 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:53:12.146 INFO:tasks.workunit.client.0.trial109.stdout: 0 0 0 0 0 0 - 0 2026-02-19T12:53:13.145 INFO:tasks.workunit.client.0.trial109.stdout: 1 16 15729 15713 61.3743 61.3789 0.000640356 0.00101666 2026-02-19T12:53:14.145 INFO:tasks.workunit.client.0.trial109.stdout: 2 16 31643 31627 61.7668 62.1641 0.000901709 0.00101068 2026-02-19T12:53:15.145 INFO:tasks.workunit.client.0.trial109.stdout: 3 16 47643 47627 62.0096 62.5 0.000506699 0.00100676 2026-02-19T12:53:16.145 INFO:tasks.workunit.client.0.trial109.stdout: 4 16 63461 63445 61.9533 61.7891 0.000879939 0.00100774 2026-02-19T12:53:17.145 INFO:tasks.workunit.client.0.trial109.stdout: 5 16 79209 79193 61.8649 61.5156 0.00112706 0.00100923 2026-02-19T12:53:18.145 INFO:tasks.workunit.client.0.trial109.stdout: 6 16 94612 94596 61.5813 60.168 0.000743356 0.00101388 2026-02-19T12:53:19.146 INFO:tasks.workunit.client.0.trial109.stdout: 7 16 109538 109522 61.1126 58.3047 0.0007724 0.00102167 2026-02-19T12:53:20.145 INFO:tasks.workunit.client.0.trial109.stdout: 8 16 123589 123573 60.3339 54.8867 0.00159534 0.00103487 2026-02-19T12:53:21.146 INFO:tasks.workunit.client.0.trial109.stdout: 9 16 137663 137647 59.7382 54.9766 0.00130808 0.00104524 2026-02-19T12:53:22.145 INFO:tasks.workunit.client.0.trial109.stdout: 10 16 151947 151931 59.3436 55.7969 0.000902291 0.00105217 2026-02-19T12:53:23.146 INFO:tasks.workunit.client.0.trial109.stdout: 11 15 165921 165906 58.9111 54.5898 0.00104165 0.00105991 2026-02-19T12:53:24.146 INFO:tasks.workunit.client.0.trial109.stdout: 12 16 179316 179300 58.3615 52.3203 0.000760368 0.00106988 2026-02-19T12:53:25.146 INFO:tasks.workunit.client.0.trial109.stdout: 13 16 192669 192653 57.8842 52.1602 0.00109769 0.00107875 2026-02-19T12:53:26.146 INFO:tasks.workunit.client.0.trial109.stdout: 14 16 206149 206133 57.5105 52.6562 0.00150928 0.00108575 2026-02-19T12:53:27.146 INFO:tasks.workunit.client.0.trial109.stdout: 15 16 219663 219647 57.1955 52.7891 0.00128535 0.00109176 2026-02-19T12:53:28.146 INFO:tasks.workunit.client.0.trial109.stdout: 16 15 233067 233052 56.8932 52.3633 0.00103933 0.00109755 2026-02-19T12:53:29.146 INFO:tasks.workunit.client.0.trial109.stdout: 17 16 246678 246662 56.6736 53.1641 0.00078288 0.00110181 2026-02-19T12:53:30.146 INFO:tasks.workunit.client.0.trial109.stdout: 18 16 260270 260254 56.4745 53.0938 0.000924051 0.00110568 2026-02-19T12:53:31.146 INFO:tasks.workunit.client.0.trial109.stdout: 19 16 273664 273648 56.2557 52.3203 0.000705327 0.00111001 2026-02-19T12:53:32.146 INFO:tasks.workunit.client.0.trial109.stdout:2026-02-19T12:53:32.147250+0000 min lat: 0.000350349 max lat: 0.0571367 avg lat: 0.00115011 2026-02-19T12:53:32.146 INFO:tasks.workunit.client.0.trial109.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T12:53:32.146 INFO:tasks.workunit.client.0.trial109.stdout: 20 16 277919 277903 54.2739 16.6211 0.0456287 0.00115011 2026-02-19T12:53:33.146 INFO:tasks.workunit.client.0.trial109.stdout: 21 16 278605 278589 51.817 2.67969 0.0182579 0.00120466 2026-02-19T12:53:34.146 INFO:tasks.workunit.client.0.trial109.stdout: 22 16 279204 279188 49.5681 2.33984 0.0253467 0.00125882 2026-02-19T12:53:35.147 INFO:tasks.workunit.client.0.trial109.stdout: 23 16 279867 279851 47.5255 2.58984 0.214949 0.00130811 2026-02-19T12:53:36.147 INFO:tasks.workunit.client.0.trial109.stdout: 24 16 281605 281589 45.8282 6.78906 0.00147382 0.00136278 2026-02-19T12:53:37.147 INFO:tasks.workunit.client.0.trial109.stdout: 25 16 295140 295124 46.1097 52.8711 0.00161265 0.00135447 2026-02-19T12:53:38.147 INFO:tasks.workunit.client.0.trial109.stdout: 26 16 308586 308570 46.3562 52.5234 0.000913682 0.00134726 2026-02-19T12:53:39.147 INFO:tasks.workunit.client.0.trial109.stdout: 27 16 321979 321963 46.5769 52.3164 0.00105071 0.00134088 2026-02-19T12:53:40.147 INFO:tasks.workunit.client.0.trial109.stdout: 28 15 335187 335172 46.756 51.5977 0.00108316 0.00133573 2026-02-19T12:53:41.147 INFO:tasks.workunit.client.0.trial109.stdout: 29 16 348587 348571 46.9484 52.3398 0.00113396 0.00133026 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Total time run: 30.0009 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Total writes made: 362051 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Write size: 4096 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Object size: 4096 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Bandwidth (MB/sec): 47.1407 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Bandwidth: 19.3969 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Max bandwidth (MB/sec): 62.5 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Min bandwidth (MB/sec): 2.33984 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Average IOPS: 12068 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Stddev IOPS: 4965.61 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Max IOPS: 16000 2026-02-19T12:53:42.147 INFO:tasks.workunit.client.0.trial109.stdout:Min IOPS: 599 2026-02-19T12:53:42.148 INFO:tasks.workunit.client.0.trial109.stdout:Average Latency(s): 0.00132484 2026-02-19T12:53:42.148 INFO:tasks.workunit.client.0.trial109.stdout:Stddev Latency(s): 0.00355923 2026-02-19T12:53:42.148 INFO:tasks.workunit.client.0.trial109.stdout:Max latency(s): 0.275468 2026-02-19T12:53:42.148 INFO:tasks.workunit.client.0.trial109.stdout:Min latency(s): 0.000350349 2026-02-19T12:53:42.151 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:435: TEST_bluestore_expand: sleep 5 2026-02-19T12:53:47.154 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-19T12:53:47.154 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-19T12:53:47.237 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: total_space_before=4294967296 2026-02-19T12:53:47.239 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-19T12:53:47.239 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-19T12:53:47.239 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep free 2026-02-19T12:53:47.239 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d: -f 2 2026-02-19T12:53:47.239 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d, -f 1 2026-02-19T12:53:47.239 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-19T12:53:47.325 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: free_space_before=2811916288 2026-02-19T12:53:47.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 137671 2026-02-19T12:53:47.326 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: sleep 1 2026-02-19T12:53:48.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 137671 2026-02-19T12:53:48.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 441: kill: (137671) - No such process 2026-02-19T12:53:48.327 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:442: TEST_bluestore_expand: ceph osd down 0 2026-02-19T12:53:48.543 INFO:tasks.workunit.client.0.trial109.stderr:osd.0 is already down. 2026-02-19T12:53:48.553 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:445: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 allocmap 2026-02-19T12:53:48.577 INFO:tasks.workunit.client.0.trial109.stdout:allocmap bluestore.allocmap 2026-02-19T12:54:37.108 INFO:tasks.workunit.client.0.trial109.stdout:allocmap success 2026-02-19T12:54:37.139 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:448: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:55:26.096 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:55:26.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:450: TEST_bluestore_expand: requested_space=4294967296 2026-02-19T12:55:26.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:451: TEST_bluestore_expand: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-19T12:55:26.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:452: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-19T12:55:26.149 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:56:13.304 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x40000000(1 GiB) : using 0x2ac00000(684 MiB) 2026-02-19T12:56:13.304 INFO:tasks.workunit.client.0.trial109.stdout:2 : device size 0x100000000(4 GiB) : using 0x5865b000(1.4 GiB) 2026-02-19T12:56:13.304 INFO:tasks.workunit.client.0.trial109.stdout:Expanding DB/WAL... 2026-02-19T12:56:13.304 INFO:tasks.workunit.client.0.trial109.stdout:1 : nothing to do, skipped 2026-02-19T12:56:13.304 INFO:tasks.workunit.client.0.trial109.stdout:2 : nothing to do, skipped 2026-02-19T12:56:13.475 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:455: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T12:57:03.572 INFO:tasks.workunit.client.0.trial109.stdout:fsck success 2026-02-19T12:57:03.603 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:458: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 qfsck 2026-02-19T12:57:03.620 INFO:tasks.workunit.client.0.trial109.stdout:qfsck bluestore.quick-fsck 2026-02-19T12:57:52.132 INFO:tasks.workunit.client.0.trial109.stdout:qfsck success 2026-02-19T12:57:52.160 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:460: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-19T12:57:52.178 INFO:tasks.workunit.client.0.trial109.stdout:inferring bluefs devices from bluestore path 2026-02-19T12:58:39.661 INFO:tasks.workunit.client.0.trial109.stdout:1 : device size 0x40000000(1 GiB) : using 0x2ac00000(684 MiB) 2026-02-19T12:58:39.661 INFO:tasks.workunit.client.0.trial109.stdout:2 : device size 0x100000000(4 GiB) : using 0x5865b000(1.4 GiB) 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:462: TEST_bluestore_expand: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=18f185c5-8817-4e35-bb2b-57f87705679c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T12:58:39.791 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T12:58:39.792 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T12:58:39.793 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T12:58:39.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T12:58:39.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T12:58:39.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T12:58:39.794 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T12:58:39.794 INFO:tasks.workunit.client.0.trial109.stdout:start osd.0 2026-02-19T12:58:39.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T12:58:39.795 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d9acdfa1-1912-45ed-bf20-685044223294 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=576c0740-2d1f-497f-981f-aaf1b6e4a92e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=18f185c5-8817-4e35-bb2b-57f87705679c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83893/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T12:58:39.796 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T12:58:39.796 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T12:58:39.796 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T12:58:39.796 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T12:58:39.796 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T12:58:39.814 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:58:39.810+0000 7f87f7990a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:58:39.815 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:58:39.810+0000 7f87f7990a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:58:39.816 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:58:39.814+0000 7f87f7990a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T12:58:40.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T12:58:40.016 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T12:58:40.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T12:58:40.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T12:58:40.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T12:58:40.017 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:40.017 INFO:tasks.workunit.client.0.trial109.stdout:0 2026-02-19T12:58:40.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T12:58:40.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:40.018 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:40.236 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:40.246 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:58:40.242+0000 7f87f7990a40 -1 Falling back to public interface 2026-02-19T12:58:41.237 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:41.238 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:41.238 INFO:tasks.workunit.client.0.trial109.stdout:1 2026-02-19T12:58:41.239 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T12:58:41.239 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:41.239 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:41.463 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:42.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:42.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:42.465 INFO:tasks.workunit.client.0.trial109.stdout:2 2026-02-19T12:58:42.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T12:58:42.466 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:42.466 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:42.682 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:43.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:43.683 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:43.684 INFO:tasks.workunit.client.0.trial109.stdout:3 2026-02-19T12:58:43.684 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T12:58:43.685 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:43.685 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:43.906 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:44.908 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:44.908 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:44.908 INFO:tasks.workunit.client.0.trial109.stdout:4 2026-02-19T12:58:44.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T12:58:44.909 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:44.910 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:45.128 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:46.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:46.129 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:46.130 INFO:tasks.workunit.client.0.trial109.stdout:5 2026-02-19T12:58:46.130 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T12:58:46.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:46.131 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:46.346 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:47.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:47.348 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:47.349 INFO:tasks.workunit.client.0.trial109.stdout:6 2026-02-19T12:58:47.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T12:58:47.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:47.350 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:48.088 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:49.089 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:49.089 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:49.090 INFO:tasks.workunit.client.0.trial109.stdout:7 2026-02-19T12:58:49.090 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T12:58:49.090 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:49.091 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:49.309 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:50.311 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:50.311 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:50.311 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T12:58:50.311 INFO:tasks.workunit.client.0.trial109.stdout:8 2026-02-19T12:58:50.312 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:50.312 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:50.529 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:51.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:51.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:51.531 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2026-02-19T12:58:51.531 INFO:tasks.workunit.client.0.trial109.stdout:9 2026-02-19T12:58:51.532 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:51.532 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:51.749 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:52.751 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:52.751 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:52.751 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2026-02-19T12:58:52.752 INFO:tasks.workunit.client.0.trial109.stdout:10 2026-02-19T12:58:52.752 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:52.752 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:52.974 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:53.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:53.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:53.975 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2026-02-19T12:58:53.976 INFO:tasks.workunit.client.0.trial109.stdout:11 2026-02-19T12:58:53.976 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:53.976 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:54.198 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T12:58:54.357 INFO:tasks.workunit.client.0.trial109.stderr:2026-02-19T12:58:54.354+0000 7f87f7990a40 -1 osd.0 9 log_to_monitors true 2026-02-19T12:58:55.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T12:58:55.199 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T12:58:55.200 INFO:tasks.workunit.client.0.trial109.stdout:12 2026-02-19T12:58:55.200 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2026-02-19T12:58:55.201 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T12:58:55.201 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T12:58:55.421 INFO:tasks.workunit.client.0.trial109.stdout:osd.0 up in weight 1 up_from 12 up_thru 12 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6802/3743188946,v1:127.0.0.1:6803/3743188946] [v2:127.0.0.1:6804/3743188946,v1:127.0.0.1:6805/3743188946] exists,up 38c6b7c3-07fc-4daf-82f2-620b9d97d152 2026-02-19T12:58:55.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T12:58:55.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T12:58:55.422 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T12:58:55.422 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: osd_pid0=142516 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:465: TEST_bluestore_expand: wait_for_clean 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T12:58:55.425 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T12:58:55.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T12:58:55.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T12:58:55.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T12:58:55.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T12:58:55.521 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T12:58:55.521 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T12:58:55.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-19T12:58:55.746 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T12:58:55.747 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T12:58:55.747 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-19T12:58:55.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607555 2026-02-19T12:58:55.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607555 2026-02-19T12:58:55.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-51539607555' 2026-02-19T12:58:55.830 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-19T12:58:55.831 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-51539607555 2026-02-19T12:58:55.831 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-19T12:58:55.831 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-19T12:58:55.832 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-51539607555 2026-02-19T12:58:55.832 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-19T12:58:55.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607555 2026-02-19T12:58:55.834 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-19T12:58:55.834 INFO:tasks.workunit.client.0.trial109.stdout:waiting osd.0 seq 51539607555 2026-02-19T12:58:55.834 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:58:56.056 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 51539607555 2026-02-19T12:58:56.057 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:58:57.058 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T12:58:57.058 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:58:57.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 51539607555 2026-02-19T12:58:57.270 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-19T12:58:58.271 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T12:58:58.272 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T12:58:58.490 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-19T12:58:58.491 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T12:58:58.491 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:58:58.491 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:58:58.782 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T12:58:58.782 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T12:58:58.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T12:58:58.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T12:58:58.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T12:58:58.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T12:58:58.782 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T12:58:58.783 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T12:58:59.003 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T12:58:59.003 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T12:58:59.004 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T12:58:59.004 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T12:58:59.294 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T12:58:59.294 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T12:58:59.294 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T12:58:59.295 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-19T12:58:59.295 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-19T12:58:59.378 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: total_space_after=4294967296 2026-02-19T12:58:59.379 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-19T12:58:59.380 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-19T12:58:59.380 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep free 2026-02-19T12:58:59.380 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d: -f 2 2026-02-19T12:58:59.380 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d, -f 1 2026-02-19T12:58:59.380 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-19T12:58:59.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: free_space_after=2784538624 2026-02-19T12:58:59.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:470: TEST_bluestore_expand: '[' 4294967296 '!=' 4294967296 ']' 2026-02-19T12:58:59.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:476: TEST_bluestore_expand: total_space_added=0 2026-02-19T12:58:59.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:477: TEST_bluestore_expand: free_space_added=-27377664 2026-02-19T12:58:59.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:479: TEST_bluestore_expand: let 'new_used_space=(0 - -27377664)' 2026-02-19T12:58:59.464 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:480: TEST_bluestore_expand: echo 27377664 2026-02-19T12:58:59.465 INFO:tasks.workunit.client.0.trial109.stdout:27377664 2026-02-19T12:58:59.465 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:482: TEST_bluestore_expand: '[' 27377664 -gt 131072 ']' 2026-02-19T12:58:59.465 INFO:tasks.workunit.client.0.trial109.stdout:total_space_added = 0 2026-02-19T12:58:59.466 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:483: TEST_bluestore_expand: echo 'total_space_added = 0' 2026-02-19T12:58:59.466 INFO:tasks.workunit.client.0.trial109.stdout:free_space_added = -27377664 2026-02-19T12:58:59.467 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:484: TEST_bluestore_expand: echo 'free_space_added = -27377664' 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:485: TEST_bluestore_expand: return 1 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: main: code=1 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/osd-bluefs-volume-ops 1 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T12:58:59.468 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T12:58:59.469 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T12:58:59.469 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T12:58:59.571 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T12:58:59.572 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T12:58:59.573 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T12:58:59.573 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T12:58:59.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T12:58:59.575 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T12:58:59.575 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T12:58:59.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:58:59.576 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T12:58:59.577 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T12:58:59.577 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T12:58:59.578 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:58:59.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2026-02-19T12:58:59.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-19T12:58:59.580 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-19T12:58:59.581 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/bluestore_tool.log td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log /home/ubuntu/cephtest/archive/log 2026-02-19T12:58:59.582 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T12:58:59.650 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T12:58:59.651 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T12:58:59.651 INFO:tasks.workunit.client.0.trial109.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83893 2026-02-19T12:58:59.651 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83893 2026-02-19T12:58:59.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T12:58:59.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T12:58:59.652 INFO:tasks.workunit.client.0.trial109.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 1 2026-02-19T12:58:59.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T12:58:59.653 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-19T12:58:59.653 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-19T12:59:00.044 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_NitzanMordhai_ceph_624b9a7bcb2064ce17206482df6a1da007ff7675/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_NitzanMordhai_ceph_624b9a7bcb2064ce17206482df6a1da007ff7675/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_NitzanMordhai_ceph_624b9a7bcb2064ce17206482df6a1da007ff7675/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial109 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=624b9a7bcb2064ce17206482df6a1da007ff7675 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-19T12:59:00.049 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-19T12:59:00.062 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-19T12:59:00.063 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-19T12:59:00.170 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-19T12:59:00.181 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-19T12:59:00.181 DEBUG:teuthology.orchestra.run.trial109:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T12:59:00.219 INFO:teuthology.orchestra.run.trial109.stdout: remote refid st t when poll reach delay offset jitter 2026-02-19T12:59:00.219 INFO:teuthology.orchestra.run.trial109.stdout:============================================================================== 2026-02-19T12:59:00.219 INFO:teuthology.orchestra.run.trial109.stdout:+66.42.71.197 (6 132.239.1.6 2 u 65 64 377 62.019 -2.197 5.023 2026-02-19T12:59:00.220 INFO:teuthology.orchestra.run.trial109.stdout:-172-234-44-141. 80.192.165.246 2 u 65 64 377 7.548 -20.304 1.055 2026-02-19T12:59:00.220 INFO:teuthology.orchestra.run.trial109.stdout:+23.157.160.168 129.6.15.28 2 u 8 64 377 3.221 -5.428 1.938 2026-02-19T12:59:00.220 INFO:teuthology.orchestra.run.trial109.stdout:*vps-lga1.orlean 17.253.2.43 2 u 4 64 377 3.168 -1.531 0.425 2026-02-19T12:59:00.220 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-19T12:59:00.233 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-19T12:59:00.233 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-19T12:59:00.246 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-19T12:59:00.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-19T12:59:00.273 INFO:teuthology.task.internal:Duration was 1581.721896 seconds 2026-02-19T12:59:00.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-19T12:59:00.287 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-19T12:59:00.288 DEBUG:teuthology.orchestra.run.trial109:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-19T12:59:00.312 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-19T12:59:00.312 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial109.front.sepia.ceph.com 2026-02-19T12:59:00.312 DEBUG:teuthology.orchestra.run.trial109:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-19T12:59:00.361 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-19T12:59:00.361 DEBUG:teuthology.orchestra.run.trial109:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T12:59:00.611 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-19T12:59:00.611 DEBUG:teuthology.orchestra.run.trial109:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T12:59:00.620 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T12:59:00.621 INFO:teuthology.orchestra.run.trial109.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T12:59:00.621 INFO:teuthology.orchestra.run.trial109.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T12:59:00.622 INFO:teuthology.orchestra.run.trial109.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-19T12:59:00.622 INFO:teuthology.orchestra.run.trial109.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-19T12:59:00.683 INFO:teuthology.orchestra.run.trial109.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-19T12:59:00.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-19T12:59:00.695 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-19T12:59:00.696 DEBUG:teuthology.orchestra.run.trial109:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-19T12:59:00.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-19T12:59:00.746 DEBUG:teuthology.orchestra.run.trial109:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:59:00.783 INFO:teuthology.orchestra.run.trial109.stdout:kernel.core_pattern = core 2026-02-19T12:59:00.793 DEBUG:teuthology.orchestra.run.trial109:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-19T12:59:00.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T12:59:00.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-19T12:59:00.856 INFO:teuthology.task.internal:Transferring archived files... 2026-02-19T12:59:00.859 DEBUG:teuthology.misc:Transferring archived files from trial109:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/nmordech-2026-02-19_12:10:46-rados-wip-rocky10-branch-of-the-day-2026-02-18-1771415652-tentacle-distro-default-trial/58589/remote/trial109 2026-02-19T12:59:00.860 DEBUG:teuthology.orchestra.run.trial109:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-19T14:01:27.428 INFO:teuthology.task.internal:Removing archive directory... 2026-02-19T14:01:27.434 DEBUG:teuthology.orchestra.run.trial109:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-19T14:01:31.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-19T14:01:31.293 INFO:teuthology.task.internal:Not uploading archives. 2026-02-19T14:01:31.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-19T14:01:31.310 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-19T14:01:31.310 DEBUG:teuthology.orchestra.run.trial109:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-19T14:01:31.315 INFO:teuthology.orchestra.run.trial109.stdout: 1179687 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 19 14:01 /home/ubuntu/cephtest 2026-02-19T14:01:31.315 INFO:teuthology.orchestra.run.trial109.stdout: 1188736 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 19 12:34 /home/ubuntu/cephtest/mnt.0 2026-02-19T14:01:31.315 INFO:teuthology.orchestra.run.trial109.stdout: 1188737 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 19 12:44 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-19T14:01:31.316 INFO:teuthology.orchestra.run.trial109.stdout: 1204317 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 19 12:44 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T14:01:31.316 INFO:teuthology.orchestra.run.trial109.stdout: 1204318 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 19 12:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-19T14:01:31.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T14:01:31.317 INFO:teuthology.orchestra.run.trial109.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-19T14:01:31.317 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial109 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-19T14:01:31.321 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-19T14:01:31.345 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-19T14:01:31.363 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial109 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-19T14:01:31.369 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 1581.7218964099884 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial109 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=624b9a7bcb2064ce17206482df6a1da007ff7675 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_nmordech@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-19T14:01:31.369 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T14:01:31.479 INFO:teuthology.run:FAIL