2026-02-19T17:09:46.473 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-19T17:09:46.487 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T17:09:46.563 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-19_15:38:40-rados-wip-yuri-testing-2026-02-18-1820-distro-default-trial/59215 branch: wip-yuri-testing-2026-02-18-1820 description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '59215' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-19_15:38:40-rados-wip-yuri-testing-2026-02-18-1820-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri-testing-2026-02-18-1820 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 802bf111cd55e57f5842153d7ba2b8b964aa818a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 802bf111cd55e57f5842153d7ba2b8b964aa818a workunit: branch: wip-yuri-testing-2026-02-18-1820 sha1: 802bf111cd55e57f5842153d7ba2b8b964aa818a owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 7379 sha1: 802bf111cd55e57f5842153d7ba2b8b964aa818a sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri-testing-2026-02-18-1820 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_802bf111cd55e57f5842153d7ba2b8b964aa818a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 802bf111cd55e57f5842153d7ba2b8b964aa818a targets: trial119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTT1QnRbUCuaaDerB0tRiEwCjvz5WarwDhwK40CYA6hnuX4IkPhuXyP1pMHBLgZ8MbS+i34fksMLB9kMMSV+mo= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-19_15:38:40 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-19T17:09:46.564 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_802bf111cd55e57f5842153d7ba2b8b964aa818a/qa; will attempt to use it 2026-02-19T17:09:46.564 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_802bf111cd55e57f5842153d7ba2b8b964aa818a/qa/tasks 2026-02-19T17:09:46.564 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-19T17:09:46.566 INFO:teuthology.task.internal:Checking packages... 2026-02-19T17:09:46.566 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '802bf111cd55e57f5842153d7ba2b8b964aa818a' 2026-02-19T17:09:46.566 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-19T17:09:46.566 INFO:teuthology.packaging:ref: None 2026-02-19T17:09:46.566 INFO:teuthology.packaging:tag: None 2026-02-19T17:09:46.566 INFO:teuthology.packaging:branch: wip-yuri-testing-2026-02-18-1820 2026-02-19T17:09:46.566 INFO:teuthology.packaging:sha1: 802bf111cd55e57f5842153d7ba2b8b964aa818a 2026-02-19T17:09:46.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri-testing-2026-02-18-1820 2026-02-19T17:09:46.697 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5336-g802bf111-1jammy 2026-02-19T17:09:46.698 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-19T17:09:46.709 INFO:teuthology.task.internal:no buildpackages task found 2026-02-19T17:09:46.710 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-19T17:09:46.723 INFO:teuthology.task.internal:Saving configuration 2026-02-19T17:09:46.733 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-19T17:09:46.745 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-19T17:09:46.823 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial119.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-19_15:38:40-rados-wip-yuri-testing-2026-02-18-1820-distro-default-trial/59215', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-19 17:06:17.884305', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAwd+Z27eYFR3xhDA1R1exx2YIvqCiQyeXu8LbzsTM6h'} 2026-02-19T17:09:46.823 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-19T17:09:46.834 INFO:teuthology.task.internal:roles: ubuntu@trial119.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-19T17:09:46.834 INFO:teuthology.run_tasks:Running task console_log... 2026-02-19T17:09:46.917 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ae6a2f2b100>, signals=[15]) 2026-02-19T17:09:46.918 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-19T17:09:46.929 INFO:teuthology.task.internal:Opening connections... 2026-02-19T17:09:46.929 DEBUG:teuthology.task.internal:connecting to ubuntu@trial119.front.sepia.ceph.com 2026-02-19T17:09:46.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T17:09:46.993 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-19T17:09:47.004 DEBUG:teuthology.orchestra.run.trial119:> uname -m 2026-02-19T17:09:47.073 INFO:teuthology.orchestra.run.trial119.stdout:x86_64 2026-02-19T17:09:47.073 DEBUG:teuthology.orchestra.run.trial119:> cat /etc/os-release 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:NAME="Ubuntu" 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_ID="22.04" 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_CODENAME=jammy 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:ID=ubuntu 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:ID_LIKE=debian 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-19T17:09:47.121 INFO:teuthology.orchestra.run.trial119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-19T17:09:47.122 INFO:teuthology.orchestra.run.trial119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-19T17:09:47.122 INFO:teuthology.orchestra.run.trial119.stdout:UBUNTU_CODENAME=jammy 2026-02-19T17:09:47.122 INFO:teuthology.lock.ops:Updating trial119.front.sepia.ceph.com on lock server 2026-02-19T17:09:47.216 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-19T17:09:47.227 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-19T17:09:47.239 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-19T17:09:47.239 DEBUG:teuthology.orchestra.run.trial119:> test '!' -e /home/ubuntu/cephtest 2026-02-19T17:09:47.242 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-19T17:09:47.254 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-19T17:09:47.254 DEBUG:teuthology.orchestra.run.trial119:> test -z $(ls -A /var/lib/ceph) 2026-02-19T17:09:47.293 INFO:teuthology.orchestra.run.trial119.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-19T17:09:47.294 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-19T17:09:47.394 INFO:teuthology.run_tasks:Running task kernel... 2026-02-19T17:09:47.414 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-19T17:09:47.414 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-19T17:09:47.415 DEBUG:teuthology.orchestra.run.trial119:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-19T17:09:47.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T17:09:47.418 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-19T17:09:47.468 INFO:teuthology.orchestra.run.trial119.stdout:5.15.0-170-generic 2026-02-19T17:09:47.468 INFO:teuthology.task.kernel:Running kernel on trial119: 5.15.0-170-generic 2026-02-19T17:09:47.468 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get clean 2026-02-19T17:09:47.527 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-19T17:09:48.212 INFO:teuthology.orchestra.run.trial119.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-19T17:09:48.285 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-19T17:09:48.563 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-19T17:09:48.684 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-19T17:09:48.799 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3244 kB] 2026-02-19T17:09:49.127 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-19T17:09:49.137 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-19T17:09:49.137 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-19T17:09:49.166 INFO:teuthology.orchestra.run.trial119.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-19T17:09:49.172 INFO:teuthology.orchestra.run.trial119.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-19T17:09:49.172 INFO:teuthology.orchestra.run.trial119.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-19T17:09:49.301 INFO:teuthology.orchestra.run.trial119.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-19T17:09:49.319 INFO:teuthology.orchestra.run.trial119.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-19T17:09:49.391 INFO:teuthology.orchestra.run.trial119.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-19T17:09:49.398 INFO:teuthology.orchestra.run.trial119.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-19T17:09:49.398 INFO:teuthology.orchestra.run.trial119.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-19T17:09:49.429 INFO:teuthology.orchestra.run.trial119.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-19T17:09:49.429 INFO:teuthology.orchestra.run.trial119.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-19T17:09:49.549 INFO:teuthology.orchestra.run.trial119.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-19T17:09:53.120 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 22.6 MB in 3s (7821 kB/s) 2026-02-19T17:09:53.645 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-19T17:09:53.659 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-19T17:09:53.693 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-19T17:09:53.801 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-19T17:09:53.801 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-19T17:09:53.887 INFO:teuthology.orchestra.run.trial119.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-19T17:09:53.888 INFO:teuthology.orchestra.run.trial119.stdout:linux-image-generic set to manually installed. 2026-02-19T17:09:53.888 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-19T17:09:53.888 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-19T17:09:53.888 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-19T17:09:53.888 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-19T17:09:53.888 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-19T17:09:53.907 INFO:teuthology.orchestra.run.trial119.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2026-02-19T17:09:53.909 DEBUG:teuthology.orchestra.run.trial119:> dpkg -s linux-image-generic 2026-02-19T17:09:53.957 INFO:teuthology.orchestra.run.trial119.stdout:Package: linux-image-generic 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Status: install ok installed 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Priority: optional 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Section: kernel 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Installed-Size: 21 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Maintainer: Ubuntu Kernel Team 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: amd64 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Source: linux-meta 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Version: 5.15.0.170.159 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Recommends: thermald 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout:Description: Generic Linux kernel image 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout: This package will always depend on the latest generic kernel image 2026-02-19T17:09:53.958 INFO:teuthology.orchestra.run.trial119.stdout: available. 2026-02-19T17:09:53.958 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-19T17:09:53.958 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-19T17:09:53.958 DEBUG:teuthology.orchestra.run.trial119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-19T17:09:54.009 INFO:teuthology.orchestra.run.trial119.stdout:ttyS1 2026-02-19T17:09:54.039 DEBUG:teuthology.parallel:result is None 2026-02-19T17:09:54.039 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-19T17:09:54.051 INFO:teuthology.task.internal:Creating test directory... 2026-02-19T17:09:54.051 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-19T17:09:54.085 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-19T17:09:54.096 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-19T17:09:54.109 INFO:teuthology.task.internal:Creating archive directory... 2026-02-19T17:09:54.110 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-19T17:09:54.134 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-19T17:09:54.146 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-19T17:09:54.146 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-19T17:09:54.181 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:09:54.188 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:09:54.189 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-19T17:09:54.199 INFO:teuthology.task.internal:Configuring sudo... 2026-02-19T17:09:54.200 DEBUG:teuthology.orchestra.run.trial119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-19T17:09:54.236 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-19T17:09:54.248 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-19T17:09:54.248 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-19T17:09:54.281 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T17:09:54.325 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T17:09:54.373 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-19T17:09:54.373 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-19T17:09:54.426 DEBUG:teuthology.orchestra.run.trial119:> sudo service rsyslog restart 2026-02-19T17:09:54.491 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-19T17:09:54.503 INFO:teuthology.task.internal:Starting timer... 2026-02-19T17:09:54.504 INFO:teuthology.run_tasks:Running task pcp... 2026-02-19T17:09:54.524 INFO:teuthology.run_tasks:Running task selinux... 2026-02-19T17:09:54.543 DEBUG:teuthology.task.selinux:Excluding trial119: OS 'ubuntu' does not support SELinux 2026-02-19T17:09:54.543 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-19T17:09:54.543 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-19T17:09:54.543 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-19T17:09:54.543 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-19T17:09:54.560 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-19T17:09:54.568 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-19T17:09:54.569 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-19T17:12:19.344 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial119.front.sepia.ceph.com')] 2026-02-19T17:12:19.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-19T17:12:19.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T17:12:19.460 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-19T17:12:19.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-19T17:12:19.708 INFO:teuthology.run_tasks:Running task clock... 2026-02-19T17:12:19.717 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-19T17:12:19.717 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-19T17:12:19.717 DEBUG:teuthology.orchestra.run.trial119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T17:12:19.772 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-19T17:12:19.772 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Command line: ntpd -gq 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: ---------------------------------------------------- 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: ntp-4 is maintained by Network Time Foundation, 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: corporation. Support and training for ntp-4 are 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: available at https://www.nwtime.org/support 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: ---------------------------------------------------- 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: proto: precision = 0.020 usec (-25) 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: basedate set to 2022-02-04 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: gps base set to 2022-02-06 (week 2196) 2026-02-19T17:12:19.773 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-19T17:12:19.774 INFO:teuthology.orchestra.run.trial119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-19T17:12:19.774 INFO:teuthology.orchestra.run.trial119.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: restrict ::: KOD does nothing without LIMITED. 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Listen and drop on 0 v6wildcard [::]:123 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Listen normally on 2 lo 127.0.0.1:123 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Listen normally on 3 enp1s0f0 10.20.193.119:123 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Listen normally on 4 lo [::1]:123 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6132%2]:123 2026-02-19T17:12:19.775 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:19 ntpd[9413]: Listening on routing socket on fd #22 for interface updates 2026-02-19T17:12:20.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:20 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:20.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:20 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:20.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:20 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:20.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:20 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:20.841 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:20 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:20.841 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:20 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:21.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:21 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:21.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:21 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:21.775 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:21 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:21.776 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:21 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:21.776 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:21 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:21.776 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:21 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:22.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:22 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:22.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:22 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:22.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:22 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:22.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:22 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:22.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:22 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:22.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:22 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:23.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:23 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:23.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:23 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:23.775 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:23 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:23.775 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:23 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:23.775 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:23 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:23.775 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:23 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:24.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:24.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:24.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:24.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:24.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:24.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:24.802 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:24.802 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:24.802 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:24.803 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:24.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:24.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:24.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:24.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:24.851 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:24.851 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:24.851 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:24.852 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:24 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:25.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:25 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:25.772 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:25 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:25.775 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:25 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:25.775 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:25 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:25.776 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:25 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:25.776 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:25 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:26.773 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:26.773 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:26.773 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:26.773 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:26.773 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:26.773 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:26.807 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:26.807 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:26.807 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:26.807 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:26.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-19T17:12:26.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/rawstats.20260219: Permission denied 2026-02-19T17:12:26.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-19T17:12:26.840 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/peerstats.20260219: Permission denied 2026-02-19T17:12:26.841 INFO:teuthology.orchestra.run.trial119.stdout:19 Feb 17:12:26 ntpd[9413]: ntpd: time set +0.671127 s 2026-02-19T17:12:26.841 INFO:teuthology.orchestra.run.trial119.stdout:ntpd: time set +0.671127s 2026-02-19T17:12:26.841 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-19T17:12:26.841 INFO:teuthology.orchestra.run.trial119.stderr:19 Feb 17:12:26 ntpd[9413]: can't open /var/log/ntpstats/loopstats.20260219: Permission denied 2026-02-19T17:12:26.971 INFO:teuthology.orchestra.run.trial119.stdout: remote refid st t when poll reach delay offset jitter 2026-02-19T17:12:26.971 INFO:teuthology.orchestra.run.trial119.stdout:============================================================================== 2026-02-19T17:12:26.972 INFO:teuthology.orchestra.run.trial119.stdout: 24-229-44-105-s .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-19T17:12:26.972 INFO:teuthology.orchestra.run.trial119.stdout: time-east.far.n .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-19T17:12:26.972 INFO:teuthology.orchestra.run.trial119.stdout: smtp.brandonenr .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-19T17:12:26.972 INFO:teuthology.orchestra.run.trial119.stdout: ntp1.glypnod.co .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-19T17:12:26.973 INFO:teuthology.run_tasks:Running task install... 2026-02-19T17:12:26.987 DEBUG:teuthology.task.install:project ceph 2026-02-19T17:12:26.988 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '802bf111cd55e57f5842153d7ba2b8b964aa818a'}} 2026-02-19T17:12:26.988 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '802bf111cd55e57f5842153d7ba2b8b964aa818a'} 2026-02-19T17:12:26.988 INFO:teuthology.task.install:Using flavor: default 2026-02-19T17:12:26.998 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-19T17:12:26.998 INFO:teuthology.task.install:extra packages: [] 2026-02-19T17:12:26.999 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-key list | grep Ceph 2026-02-19T17:12:27.065 INFO:teuthology.orchestra.run.trial119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-19T17:12:27.096 INFO:teuthology.orchestra.run.trial119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-19T17:12:27.097 INFO:teuthology.orchestra.run.trial119.stdout:uid [ unknown] Ceph.com (release key) 2026-02-19T17:12:27.097 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-osd, ceph-osd-classic, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-19T17:12:27.098 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=802bf111cd55e57f5842153d7ba2b8b964aa818a 2026-02-19T17:12:27.309 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default/ 2026-02-19T17:12:27.309 INFO:teuthology.task.install.deb:Package version is 20.3.0-5336-g802bf111-1jammy 2026-02-19T17:12:27.474 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-19T17:12:27.474 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-19T17:12:27.483 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-19T17:12:27.643 INFO:teuthology.orchestra.run.trial119.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy InRelease 2026-02-19T17:12:27.654 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy Release [7005 B] 2026-02-19T17:12:27.666 INFO:teuthology.orchestra.run.trial119.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-19T17:12:27.678 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [19.2 kB] 2026-02-19T17:12:27.986 INFO:teuthology.orchestra.run.trial119.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-19T17:12:28.068 INFO:teuthology.orchestra.run.trial119.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-19T17:12:28.156 INFO:teuthology.orchestra.run.trial119.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-19T17:12:28.243 INFO:teuthology.orchestra.run.trial119.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-19T17:12:28.390 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 26.2 kB in 1s (35.1 kB/s) 2026-02-19T17:12:28.911 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-19T17:12:28.925 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.3.0-5336-g802bf111-1jammy cephadm=20.3.0-5336-g802bf111-1jammy ceph-mds=20.3.0-5336-g802bf111-1jammy ceph-mgr=20.3.0-5336-g802bf111-1jammy ceph-osd=20.3.0-5336-g802bf111-1jammy ceph-osd-classic=20.3.0-5336-g802bf111-1jammy ceph-common=20.3.0-5336-g802bf111-1jammy ceph-fuse=20.3.0-5336-g802bf111-1jammy ceph-test=20.3.0-5336-g802bf111-1jammy ceph-volume=20.3.0-5336-g802bf111-1jammy radosgw=20.3.0-5336-g802bf111-1jammy python3-rados=20.3.0-5336-g802bf111-1jammy python3-rgw=20.3.0-5336-g802bf111-1jammy python3-cephfs=20.3.0-5336-g802bf111-1jammy python3-rbd=20.3.0-5336-g802bf111-1jammy libcephfs2=20.3.0-5336-g802bf111-1jammy libcephfs-dev=20.3.0-5336-g802bf111-1jammy librados2=20.3.0-5336-g802bf111-1jammy librbd1=20.3.0-5336-g802bf111-1jammy rbd-fuse=20.3.0-5336-g802bf111-1jammy 2026-02-19T17:12:28.959 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-19T17:12:29.069 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-19T17:12:29.069 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-19T17:12:29.160 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-19T17:12:29.160 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-19T17:12:29.160 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout:The following additional packages will be installed: 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon jq libcephfs-daemon 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: nvme-cli python-asyncssh-doc python3-asyncssh python3-cachetools 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-argparse python3-ceph-common python3-cheroot python3-cherrypy3 2026-02-19T17:12:29.161 INFO:teuthology.orchestra.run.trial119.stdout: python3-google-auth python3-iniconfig python3-jaraco.classes 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-joblib python3-kubernetes python3-natsort python3-pluggy 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-portend python3-prettytable python3-psutil python3-py 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-pygments python3-pytest python3-repoze.lru python3-requests-oauthlib 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-routes python3-rsa python3-simplejson python3-sklearn 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-sklearn-lib python3-tempora python3-threadpoolctl python3-toml 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-wcwidth python3-webob python3-websocket python3-zc.lockfile 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: qttranslations5-l10n socat xmlstarlet 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout:Suggested packages: 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-19T17:12:29.162 INFO:teuthology.orchestra.run.trial119.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-19T17:12:29.163 INFO:teuthology.orchestra.run.trial119.stdout:Recommended packages: 2026-02-19T17:12:29.163 INFO:teuthology.orchestra.run.trial119.stdout: btrfs-tools 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout:The following NEW packages will be installed: 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-osd-classic ceph-test 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: ceph-volume cephadm jq libcephfs-daemon libcephfs-dev libcephfs-proxy2 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-19T17:12:29.195 INFO:teuthology.orchestra.run.trial119.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-19T17:12:29.196 INFO:teuthology.orchestra.run.trial119.stdout: socat xmlstarlet 2026-02-19T17:12:29.273 INFO:teuthology.orchestra.run.trial119.stdout:0 upgraded, 87 newly installed, 0 to remove and 13 not upgraded. 2026-02-19T17:12:29.273 INFO:teuthology.orchestra.run.trial119.stdout:Need to get 708 MB of archives. 2026-02-19T17:12:29.273 INFO:teuthology.orchestra.run.trial119.stdout:After this operation, 2689 MB of additional disk space will be used. 2026-02-19T17:12:29.273 INFO:teuthology.orchestra.run.trial119.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.3.0-5336-g802bf111-1jammy [3927 kB] 2026-02-19T17:12:29.380 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.3.0-5336-g802bf111-1jammy [2913 kB] 2026-02-19T17:12:29.419 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.3.0-5336-g802bf111-1jammy [883 kB] 2026-02-19T17:12:29.433 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.3.0-5336-g802bf111-1jammy [359 kB] 2026-02-19T17:12:29.439 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.3.0-5336-g802bf111-1jammy [32.8 kB] 2026-02-19T17:12:29.440 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.3.0-5336-g802bf111-1jammy [225 kB] 2026-02-19T17:12:29.444 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.3.0-5336-g802bf111-1jammy [88.4 kB] 2026-02-19T17:12:29.445 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.3.0-5336-g802bf111-1jammy [339 kB] 2026-02-19T17:12:29.450 INFO:teuthology.orchestra.run.trial119.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.3.0-5336-g802bf111-1jammy [9087 kB] 2026-02-19T17:12:29.600 INFO:teuthology.orchestra.run.trial119.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.3.0-5336-g802bf111-1jammy [113 kB] 2026-02-19T17:12:29.601 INFO:teuthology.orchestra.run.trial119.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.3.0-5336-g802bf111-1jammy [264 kB] 2026-02-19T17:12:29.605 INFO:teuthology.orchestra.run.trial119.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.3.0-5336-g802bf111-1jammy [31.6 MB] 2026-02-19T17:12:29.622 INFO:teuthology.orchestra.run.trial119.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-19T17:12:30.048 INFO:teuthology.orchestra.run.trial119.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-19T17:12:30.062 INFO:teuthology.orchestra.run.trial119.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-19T17:12:30.127 INFO:teuthology.orchestra.run.trial119.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.3.0-5336-g802bf111-1jammy [5000 kB] 2026-02-19T17:12:30.150 INFO:teuthology.orchestra.run.trial119.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-19T17:12:30.204 INFO:teuthology.orchestra.run.trial119.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.3.0-5336-g802bf111-1jammy [293 kB] 2026-02-19T17:12:30.208 INFO:teuthology.orchestra.run.trial119.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.3.0-5336-g802bf111-1jammy [127 kB] 2026-02-19T17:12:30.210 INFO:teuthology.orchestra.run.trial119.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.3.0-5336-g802bf111-1jammy [923 kB] 2026-02-19T17:12:30.226 INFO:teuthology.orchestra.run.trial119.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.3.0-5336-g802bf111-1jammy [7543 kB] 2026-02-19T17:12:30.350 INFO:teuthology.orchestra.run.trial119.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-classic amd64 20.3.0-5336-g802bf111-1jammy [474 MB] 2026-02-19T17:12:30.404 INFO:teuthology.orchestra.run.trial119.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-19T17:12:30.417 INFO:teuthology.orchestra.run.trial119.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-19T17:12:30.451 INFO:teuthology.orchestra.run.trial119.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-19T17:12:30.462 INFO:teuthology.orchestra.run.trial119.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-19T17:12:30.464 INFO:teuthology.orchestra.run.trial119.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-19T17:12:30.465 INFO:teuthology.orchestra.run.trial119.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-19T17:12:30.466 INFO:teuthology.orchestra.run.trial119.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-19T17:12:30.487 INFO:teuthology.orchestra.run.trial119.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-19T17:12:30.488 INFO:teuthology.orchestra.run.trial119.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-19T17:12:30.496 INFO:teuthology.orchestra.run.trial119.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-19T17:12:30.580 INFO:teuthology.orchestra.run.trial119.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-19T17:12:30.580 INFO:teuthology.orchestra.run.trial119.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-19T17:12:30.580 INFO:teuthology.orchestra.run.trial119.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-19T17:12:30.580 INFO:teuthology.orchestra.run.trial119.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-19T17:12:30.581 INFO:teuthology.orchestra.run.trial119.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-19T17:12:30.581 INFO:teuthology.orchestra.run.trial119.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-19T17:12:30.581 INFO:teuthology.orchestra.run.trial119.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-19T17:12:30.587 INFO:teuthology.orchestra.run.trial119.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-19T17:12:30.587 INFO:teuthology.orchestra.run.trial119.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-19T17:12:30.675 INFO:teuthology.orchestra.run.trial119.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-19T17:12:30.677 INFO:teuthology.orchestra.run.trial119.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-19T17:12:30.677 INFO:teuthology.orchestra.run.trial119.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-19T17:12:30.678 INFO:teuthology.orchestra.run.trial119.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-19T17:12:30.710 INFO:teuthology.orchestra.run.trial119.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-19T17:12:30.712 INFO:teuthology.orchestra.run.trial119.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-19T17:12:30.713 INFO:teuthology.orchestra.run.trial119.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-19T17:12:30.786 INFO:teuthology.orchestra.run.trial119.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-19T17:12:30.787 INFO:teuthology.orchestra.run.trial119.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-19T17:12:30.787 INFO:teuthology.orchestra.run.trial119.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-19T17:12:30.788 INFO:teuthology.orchestra.run.trial119.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-19T17:12:30.788 INFO:teuthology.orchestra.run.trial119.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-19T17:12:30.788 INFO:teuthology.orchestra.run.trial119.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-19T17:12:30.863 INFO:teuthology.orchestra.run.trial119.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-19T17:12:30.864 INFO:teuthology.orchestra.run.trial119.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-19T17:12:30.865 INFO:teuthology.orchestra.run.trial119.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-19T17:12:30.954 INFO:teuthology.orchestra.run.trial119.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-19T17:12:30.957 INFO:teuthology.orchestra.run.trial119.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-19T17:12:30.960 INFO:teuthology.orchestra.run.trial119.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-19T17:12:30.965 INFO:teuthology.orchestra.run.trial119.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-19T17:12:30.968 INFO:teuthology.orchestra.run.trial119.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-19T17:12:30.969 INFO:teuthology.orchestra.run.trial119.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-19T17:12:30.969 INFO:teuthology.orchestra.run.trial119.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-19T17:12:31.045 INFO:teuthology.orchestra.run.trial119.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-19T17:12:31.045 INFO:teuthology.orchestra.run.trial119.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-19T17:12:31.053 INFO:teuthology.orchestra.run.trial119.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-19T17:12:31.136 INFO:teuthology.orchestra.run.trial119.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-19T17:12:31.138 INFO:teuthology.orchestra.run.trial119.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-19T17:12:31.139 INFO:teuthology.orchestra.run.trial119.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-19T17:12:31.140 INFO:teuthology.orchestra.run.trial119.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-19T17:12:38.427 INFO:teuthology.orchestra.run.trial119.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.3.0-5336-g802bf111-1jammy [181 kB] 2026-02-19T17:12:38.428 INFO:teuthology.orchestra.run.trial119.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.3.0-5336-g802bf111-1jammy [14.0 kB] 2026-02-19T17:12:38.428 INFO:teuthology.orchestra.run.trial119.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.3.0-5336-g802bf111-1jammy [1033 kB] 2026-02-19T17:12:38.433 INFO:teuthology.orchestra.run.trial119.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.3.0-5336-g802bf111-1jammy [2441 kB] 2026-02-19T17:12:38.446 INFO:teuthology.orchestra.run.trial119.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.3.0-5336-g802bf111-1jammy [1069 kB] 2026-02-19T17:12:38.451 INFO:teuthology.orchestra.run.trial119.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.3.0-5336-g802bf111-1jammy [190 kB] 2026-02-19T17:12:38.452 INFO:teuthology.orchestra.run.trial119.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.3.0-5336-g802bf111-1jammy [54.8 MB] 2026-02-19T17:12:39.348 INFO:teuthology.orchestra.run.trial119.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.3.0-5336-g802bf111-1jammy [8626 kB] 2026-02-19T17:12:39.482 INFO:teuthology.orchestra.run.trial119.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.3.0-5336-g802bf111-1jammy [14.2 kB] 2026-02-19T17:12:39.482 INFO:teuthology.orchestra.run.trial119.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.3.0-5336-g802bf111-1jammy [68.7 MB] 2026-02-19T17:12:40.616 INFO:teuthology.orchestra.run.trial119.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.3.0-5336-g802bf111-1jammy [137 kB] 2026-02-19T17:12:40.617 INFO:teuthology.orchestra.run.trial119.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.3.0-5336-g802bf111-1jammy [45.8 kB] 2026-02-19T17:12:40.617 INFO:teuthology.orchestra.run.trial119.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.3.0-5336-g802bf111-1jammy [32.4 kB] 2026-02-19T17:12:40.617 INFO:teuthology.orchestra.run.trial119.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.3.0-5336-g802bf111-1jammy [44.2 kB] 2026-02-19T17:12:40.618 INFO:teuthology.orchestra.run.trial119.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.3.0-5336-g802bf111-1jammy [18.3 MB] 2026-02-19T17:12:40.913 INFO:teuthology.orchestra.run.trial119.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2026-02-18-1820/802bf111cd55e57f5842153d7ba2b8b964aa818a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.3.0-5336-g802bf111-1jammy [94.3 kB] 2026-02-19T17:12:41.192 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 708 MB in 12s (60.4 MB/s) 2026-02-19T17:12:41.208 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-19T17:12:41.363 INFO:teuthology.orchestra.run.trial119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-19T17:12:41.365 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-19T17:12:41.366 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-19T17:12:41.387 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-19T17:12:41.400 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-19T17:12:41.400 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-19T17:12:41.418 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-19T17:12:41.429 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-19T17:12:41.429 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-19T17:12:41.451 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-19T17:12:41.464 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-19T17:12:41.469 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T17:12:41.506 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-19T17:12:41.514 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-19T17:12:41.514 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T17:12:41.532 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-19T17:12:41.540 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-19T17:12:41.540 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T17:12:41.560 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-19T17:12:41.568 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-19T17:12:41.568 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-19T17:12:41.585 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librados2. 2026-02-19T17:12:41.593 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../07-librados2_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:41.593 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librados2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.637 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libnbd0. 2026-02-19T17:12:41.645 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-19T17:12:41.646 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-19T17:12:41.660 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librbd1. 2026-02-19T17:12:41.668 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../09-librbd1_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:41.668 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librbd1 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.705 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs2. 2026-02-19T17:12:41.713 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../10-libcephfs2_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:41.714 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.734 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rados. 2026-02-19T17:12:41.742 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../11-python3-rados_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:41.742 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rados (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.759 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-19T17:12:41.767 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:41.768 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-ceph-argparse (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.782 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cephfs. 2026-02-19T17:12:41.790 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../13-python3-cephfs_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:41.790 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cephfs (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.806 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-19T17:12:41.814 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../14-python3-ceph-common_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:41.814 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-ceph-common (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.833 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-19T17:12:41.841 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-19T17:12:41.841 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-19T17:12:41.857 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-prettytable. 2026-02-19T17:12:41.865 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-19T17:12:41.865 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-19T17:12:41.880 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rbd. 2026-02-19T17:12:41.888 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../17-python3-rbd_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:41.888 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rbd (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:41.906 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-19T17:12:41.914 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-19T17:12:41.914 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-19T17:12:41.932 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librgw2. 2026-02-19T17:12:41.940 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../19-librgw2_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:41.940 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librgw2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.038 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rgw. 2026-02-19T17:12:42.046 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../20-python3-rgw_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.047 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rgw (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.061 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-19T17:12:42.069 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-19T17:12:42.070 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-19T17:12:42.084 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libradosstriper1. 2026-02-19T17:12:42.092 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../22-libradosstriper1_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.093 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libradosstriper1 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.109 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-common. 2026-02-19T17:12:42.117 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../23-ceph-common_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.117 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-common (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.373 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-base. 2026-02-19T17:12:42.381 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../24-ceph-base_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.386 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-base (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.445 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-19T17:12:42.454 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-19T17:12:42.454 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-19T17:12:42.468 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cheroot. 2026-02-19T17:12:42.477 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-19T17:12:42.477 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-19T17:12:42.494 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-19T17:12:42.502 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-19T17:12:42.503 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-19T17:12:42.517 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-19T17:12:42.526 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-19T17:12:42.526 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-19T17:12:42.540 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-19T17:12:42.548 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-19T17:12:42.548 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-19T17:12:42.563 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-tempora. 2026-02-19T17:12:42.571 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-19T17:12:42.571 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-19T17:12:42.586 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-portend. 2026-02-19T17:12:42.595 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-19T17:12:42.595 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-19T17:12:42.609 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-19T17:12:42.617 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-19T17:12:42.617 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-19T17:12:42.631 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-19T17:12:42.640 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-19T17:12:42.640 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-19T17:12:42.663 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-natsort. 2026-02-19T17:12:42.671 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-19T17:12:42.672 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-19T17:12:42.688 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-19T17:12:42.696 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:42.696 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-modules-core (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.726 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-19T17:12:42.734 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.735 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libsqlite3-mod-ceph (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.749 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr. 2026-02-19T17:12:42.758 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../37-ceph-mgr_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.758 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.778 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mon. 2026-02-19T17:12:42.786 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../38-ceph-mon_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.786 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mon (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:42.851 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-19T17:12:42.859 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-19T17:12:42.859 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-19T17:12:42.874 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-osd-classic. 2026-02-19T17:12:42.882 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../40-ceph-osd-classic_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:42.882 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-osd-classic (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:46.761 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-osd. 2026-02-19T17:12:46.774 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../41-ceph-osd_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:46.774 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-osd (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:46.792 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph. 2026-02-19T17:12:46.804 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../42-ceph_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:46.805 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:46.820 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-fuse. 2026-02-19T17:12:46.833 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../43-ceph-fuse_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:46.833 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-fuse (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:46.858 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mds. 2026-02-19T17:12:46.867 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../44-ceph-mds_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:46.867 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mds (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:46.899 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package cephadm. 2026-02-19T17:12:46.907 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../45-cephadm_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:46.907 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking cephadm (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:46.924 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-19T17:12:46.932 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../46-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-19T17:12:46.932 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-19T17:12:46.953 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-19T17:12:46.962 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../47-ceph-mgr-cephadm_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:46.962 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-cephadm (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:46.983 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-19T17:12:46.991 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../48-python3-repoze.lru_0.7-2_all.deb ... 2026-02-19T17:12:46.992 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-19T17:12:47.007 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-routes. 2026-02-19T17:12:47.015 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../49-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-19T17:12:47.016 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-19T17:12:47.036 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-19T17:12:47.044 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../50-ceph-mgr-dashboard_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:47.044 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-dashboard (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:47.720 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-19T17:12:47.728 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../51-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-19T17:12:47.728 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-19T17:12:47.766 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-joblib. 2026-02-19T17:12:47.775 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../52-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-19T17:12:47.775 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-19T17:12:47.802 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-19T17:12:47.810 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../53-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-19T17:12:47.810 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-19T17:12:47.825 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-sklearn. 2026-02-19T17:12:47.834 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../54-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-19T17:12:47.834 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-19T17:12:47.916 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-19T17:12:47.924 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-local_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:47.924 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-diskprediction-local (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:48.083 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cachetools. 2026-02-19T17:12:48.092 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../56-python3-cachetools_5.0.0-1_all.deb ... 2026-02-19T17:12:48.092 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-19T17:12:48.107 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rsa. 2026-02-19T17:12:48.115 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../57-python3-rsa_4.8-1_all.deb ... 2026-02-19T17:12:48.116 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-19T17:12:48.135 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-google-auth. 2026-02-19T17:12:48.144 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../58-python3-google-auth_1.5.1-3_all.deb ... 2026-02-19T17:12:48.144 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-19T17:12:48.161 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-19T17:12:48.170 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../59-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-19T17:12:48.170 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-19T17:12:48.186 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-websocket. 2026-02-19T17:12:48.194 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../60-python3-websocket_1.2.3-1_all.deb ... 2026-02-19T17:12:48.194 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-19T17:12:48.212 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-19T17:12:48.221 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../61-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-19T17:12:48.221 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-19T17:12:48.315 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-19T17:12:48.323 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../62-ceph-mgr-k8sevents_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:48.324 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-k8sevents (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:48.338 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-19T17:12:48.346 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../63-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-19T17:12:48.346 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-19T17:12:48.362 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-19T17:12:48.371 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../64-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-19T17:12:48.372 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-19T17:12:48.386 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package jq. 2026-02-19T17:12:48.395 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../65-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-19T17:12:48.395 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-19T17:12:48.409 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package socat. 2026-02-19T17:12:48.418 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../66-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-19T17:12:48.419 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-19T17:12:48.439 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package xmlstarlet. 2026-02-19T17:12:48.447 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../67-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-19T17:12:48.448 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-19T17:12:48.484 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-test. 2026-02-19T17:12:48.493 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../68-ceph-test_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:48.493 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-test (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:49.108 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-volume. 2026-02-19T17:12:49.117 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../69-ceph-volume_20.3.0-5336-g802bf111-1jammy_all.deb ... 2026-02-19T17:12:49.117 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-volume (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:49.140 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-19T17:12:49.148 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../70-libcephfs-daemon_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:49.149 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs-daemon (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:49.163 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-19T17:12:49.171 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../71-libcephfs-proxy2_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:49.172 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs-proxy2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:49.187 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-19T17:12:49.196 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../72-libcephfs-dev_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:49.196 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs-dev (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:49.212 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package nvme-cli. 2026-02-19T17:12:49.220 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../73-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-19T17:12:49.221 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-19T17:12:49.252 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-19T17:12:49.260 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../74-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-19T17:12:49.260 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-19T17:12:49.289 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-19T17:12:49.298 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../75-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-19T17:12:49.298 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-19T17:12:49.313 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pluggy. 2026-02-19T17:12:49.322 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../76-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-19T17:12:49.322 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-19T17:12:49.338 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-psutil. 2026-02-19T17:12:49.346 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../77-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-19T17:12:49.347 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-19T17:12:49.365 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-py. 2026-02-19T17:12:49.374 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../78-python3-py_1.10.0-1_all.deb ... 2026-02-19T17:12:49.374 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-19T17:12:49.394 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pygments. 2026-02-19T17:12:49.403 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../79-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-19T17:12:49.403 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-19T17:12:49.446 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-toml. 2026-02-19T17:12:49.454 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../80-python3-toml_0.10.2-1_all.deb ... 2026-02-19T17:12:49.454 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-19T17:12:49.470 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pytest. 2026-02-19T17:12:49.478 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../81-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-19T17:12:49.479 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-19T17:12:49.501 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-simplejson. 2026-02-19T17:12:49.509 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../82-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-19T17:12:49.510 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-19T17:12:49.534 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-webob. 2026-02-19T17:12:49.542 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../83-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-19T17:12:49.542 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-19T17:12:49.559 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-19T17:12:49.568 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../84-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-19T17:12:49.568 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-19T17:12:49.635 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package radosgw. 2026-02-19T17:12:49.644 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../85-radosgw_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:49.644 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking radosgw (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:49.801 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package rbd-fuse. 2026-02-19T17:12:49.810 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../86-rbd-fuse_20.3.0-5336-g802bf111-1jammy_amd64.deb ... 2026-02-19T17:12:49.810 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking rbd-fuse (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:49.838 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-19T17:12:49.903 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-19T17:12:49.904 INFO:teuthology.orchestra.run.trial119.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-19T17:12:49.975 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-19T17:12:50.251 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-19T17:12:50.617 INFO:teuthology.orchestra.run.trial119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-19T17:12:50.627 INFO:teuthology.orchestra.run.trial119.stdout:Setting up cephadm (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:50.672 INFO:teuthology.orchestra.run.trial119.stdout:Adding system user cephadm....done 2026-02-19T17:12:50.678 INFO:teuthology.orchestra.run.trial119.stdout:usermod: no changes 2026-02-19T17:12:50.683 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-19T17:12:50.756 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-19T17:12:50.756 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-19T17:12:50.828 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-19T17:12:50.902 INFO:teuthology.orchestra.run.trial119.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-19T17:12:50.903 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-19T17:12:51.000 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-19T17:12:51.123 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-19T17:12:51.198 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-19T17:12:51.273 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-ceph-argparse (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:51.341 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-19T17:12:51.342 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-19T17:12:51.343 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-19T17:12:51.344 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-19T17:12:51.345 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-19T17:12:51.464 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-19T17:12:51.546 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs-proxy2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:51.546 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-19T17:12:51.625 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-19T17:12:51.711 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-19T17:12:51.959 INFO:teuthology.orchestra.run.trial119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-19T17:12:51.960 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-19T17:12:52.055 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-19T17:12:52.178 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-19T17:12:52.259 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-19T17:12:52.332 INFO:teuthology.orchestra.run.trial119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-19T17:12:52.333 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-ceph-common (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:52.422 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-19T17:12:52.915 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T17:12:52.920 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-19T17:12:52.996 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-19T17:12:52.997 INFO:teuthology.orchestra.run.trial119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-19T17:12:52.998 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-19T17:12:53.074 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-19T17:12:53.148 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T17:12:53.149 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-19T17:12:53.225 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-19T17:12:53.298 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-19T17:12:53.377 INFO:teuthology.orchestra.run.trial119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-19T17:12:53.378 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-19T17:12:53.462 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-19T17:12:53.463 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-19T17:12:53.535 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-19T17:12:53.621 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-19T17:12:53.693 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-19T17:12:53.694 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-19T17:12:53.827 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-19T17:12:53.899 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-19T17:12:53.900 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-19T17:12:53.985 INFO:teuthology.orchestra.run.trial119.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-19T17:12:53.985 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-19T17:12:54.118 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-19T17:12:54.119 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librados2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.120 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librgw2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.121 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libsqlite3-mod-ceph (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.122 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-19T17:12:54.636 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs2 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.637 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libradosstriper1 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.638 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librbd1 (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.639 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-modules-core (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.640 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-fuse (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:54.713 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-19T17:12:54.713 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-19T17:12:55.097 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs-dev (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.098 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rados (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.099 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs-daemon (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.100 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rbd (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.101 INFO:teuthology.orchestra.run.trial119.stdout:Setting up rbd-fuse (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.102 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rgw (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.102 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cephfs (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.104 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-common (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.130 INFO:teuthology.orchestra.run.trial119.stdout:Adding group ceph....done 2026-02-19T17:12:55.167 INFO:teuthology.orchestra.run.trial119.stdout:Adding system user ceph....done 2026-02-19T17:12:55.177 INFO:teuthology.orchestra.run.trial119.stdout:Setting system user ceph properties....done 2026-02-19T17:12:55.183 INFO:teuthology.orchestra.run.trial119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-19T17:12:55.269 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-19T17:12:55.539 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-19T17:12:55.910 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-test (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:55.911 INFO:teuthology.orchestra.run.trial119.stdout:Setting up radosgw (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:56.155 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-19T17:12:56.156 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-19T17:12:56.488 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-base (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:56.597 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-19T17:12:56.939 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mds (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:56.997 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-19T17:12:56.997 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-19T17:12:57.362 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:57.442 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-19T17:12:57.442 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-19T17:12:57.785 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-k8sevents (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:57.786 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-osd-classic (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:57.803 INFO:teuthology.orchestra.run.trial119.stdout:update-alternatives: using /usr/bin/ceph-osd-classic to provide /usr/bin/ceph-osd (ceph-osd) in auto mode 2026-02-19T17:12:57.813 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-diskprediction-local (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:57.823 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mon (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:57.895 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-19T17:12:57.895 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-19T17:12:58.252 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-cephadm (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:58.263 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-dashboard (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:58.274 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-osd (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:58.358 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-19T17:12:58.358 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-19T17:12:58.740 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:58.741 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-volume (20.3.0-5336-g802bf111-1jammy) ... 2026-02-19T17:12:58.848 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-19T17:12:58.931 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-19T17:12:59.581 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-19T17:12:59.581 INFO:teuthology.orchestra.run.trial119.stdout:Running kernel seems to be up-to-date. 2026-02-19T17:12:59.581 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-19T17:12:59.581 INFO:teuthology.orchestra.run.trial119.stdout:The processor microcode seems to be up-to-date. 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout:No services need to be restarted. 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout:No containers need to be restarted. 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout:No user sessions are running outdated binaries. 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-19T17:12:59.582 INFO:teuthology.orchestra.run.trial119.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-19T17:13:00.416 INFO:teuthology.orchestra.run.trial119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-19T17:13:00.423 DEBUG:teuthology.parallel:result is None 2026-02-19T17:13:00.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=802bf111cd55e57f5842153d7ba2b8b964aa818a 2026-02-19T17:13:00.572 DEBUG:teuthology.orchestra.run.trial119:> dpkg-query -W -f '${Version}' ceph 2026-02-19T17:13:00.583 INFO:teuthology.orchestra.run.trial119.stdout:20.3.0-5336-g802bf111-1jammy 2026-02-19T17:13:00.584 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5336-g802bf111-1jammy 2026-02-19T17:13:00.584 INFO:teuthology.task.install:The correct ceph version 20.3.0-5336-g802bf111-1jammy is installed. 2026-02-19T17:13:00.586 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-19T17:13:00.586 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-19T17:13:00.587 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-19T17:13:00.634 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-19T17:13:00.634 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-19T17:13:00.635 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/daemon-helper 2026-02-19T17:13:00.682 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-19T17:13:00.731 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-19T17:13:00.731 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-19T17:13:00.731 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-19T17:13:00.783 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-19T17:13:00.834 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-19T17:13:00.834 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-19T17:13:00.835 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/stdin-killer 2026-02-19T17:13:00.882 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-19T17:13:00.930 INFO:teuthology.run_tasks:Running task workunit... 2026-02-19T17:13:00.953 INFO:tasks.workunit:Pulling workunits from ref 802bf111cd55e57f5842153d7ba2b8b964aa818a 2026-02-19T17:13:00.953 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-19T17:13:00.953 INFO:tasks.workunit:timeout=3h 2026-02-19T17:13:00.954 INFO:tasks.workunit:cleanup=True 2026-02-19T17:13:00.954 DEBUG:teuthology.orchestra.run.trial119:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-19T17:13:00.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T17:13:00.975 INFO:teuthology.orchestra.run.trial119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-19T17:13:00.975 DEBUG:teuthology.orchestra.run.trial119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-19T17:13:01.023 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-19T17:13:01.023 DEBUG:teuthology.orchestra.run.trial119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-19T17:13:01.069 DEBUG:teuthology.orchestra.run.trial119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 802bf111cd55e57f5842153d7ba2b8b964aa818a 2026-02-19T17:13:01.121 INFO:tasks.workunit.client.0.trial119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:Note: switching to '802bf111cd55e57f5842153d7ba2b8b964aa818a'. 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:state without impacting any branches by switching back to a branch. 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: git switch -c 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:Or undo this operation with: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: git switch - 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-19T17:13:23.117 INFO:tasks.workunit.client.0.trial119.stderr:HEAD is now at 802bf111cd5 Merge branch 'wip-common-ceph_json-jfw-spirit-to-boost' of https://github.com/chardan/ceph into wip-yuri-testing-2026-02-18-1820 2026-02-19T17:13:23.127 DEBUG:teuthology.orchestra.run.trial119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-19T17:13:23.176 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-19T17:13:23.176 DEBUG:teuthology.orchestra.run.trial119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-19T17:13:23.224 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-19T17:13:23.224 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-19T17:13:23.225 DEBUG:teuthology.orchestra.run.trial119:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-19T17:13:23.279 INFO:tasks.workunit.client.0.trial119.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-19T17:13:23.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-19T17:13:23.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-19T17:13:23.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/bad-inc-map 2026-02-19T17:13:23.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-19T17:13:23.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-19T17:13:23.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:46713 2026-02-19T17:13:23.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:46713 2026-02-19T17:13:23.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-19T17:13:23.296 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none ' 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:46713 ' 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-19T17:13:23.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:13:23.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:13:23.300 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:13:23.300 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:13:23.301 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:13:23.301 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:13:23.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:13:23.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:13:23.303 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:13:23.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:23.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:13:23.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:13:23.305 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:23.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:13:23.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:13:23.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-19T17:13:23.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:13:23.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:23.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:23.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.12028 2026-02-19T17:13:23.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:13:23.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:13:23.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-19T17:13:23.310 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:13:23.311 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:23.311 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:23.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.12028 2026-02-19T17:13:23.313 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:13:23.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T17:13:23.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T17:13:23.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:13:23.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-19T17:13:23.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-19T17:13:23.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-19T17:13:23.352 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:13:23.352 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:23.352 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:23.352 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:23.352 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:23.352 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:23.352 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:23.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:13:23.384 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:13:23.385 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:13:23.385 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:13:23.385 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:13:23.385 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:13:23.385 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.12028/ceph-mon.a.asok 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:13:23.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.12028/ceph-mon.a.asok config get fsid 2026-02-19T17:13:23.441 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:13:23.442 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:13:23.442 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:13:23.442 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:13:23.442 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:13:23.442 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:13:23.442 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:13:23.442 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:13:23.443 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:13:23.443 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:23.443 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:23.443 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.12028/ceph-mon.a.asok 2026-02-19T17:13:23.444 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:13:23.444 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.12028/ceph-mon.a.asok config get mon_host 2026-02-19T17:13:23.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-19T17:13:23.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-19T17:13:23.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:13:23.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:13:23.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:13:23.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-19T17:13:23.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:13:23.604 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:13:23.604 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:23.604 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:23.605 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:23.605 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:23.605 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:23.605 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:23.605 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:13:23.606 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 ' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:23.625 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:13:23.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-19T17:13:23.627 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:13:23.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=33a330c3-c881-4e79-afb9-4b9810dbc740 2026-02-19T17:13:23.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 33a330c3-c881-4e79-afb9-4b9810dbc740' 2026-02-19T17:13:23.628 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 33a330c3-c881-4e79-afb9-4b9810dbc740 2026-02-19T17:13:23.629 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:13:23.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCzRJdpNjT2JRAARKu+wOpt6uxPBHrcoWifYw== 2026-02-19T17:13:23.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCzRJdpNjT2JRAARKu+wOpt6uxPBHrcoWifYw=="}' 2026-02-19T17:13:23.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 33a330c3-c881-4e79-afb9-4b9810dbc740 -i td/bad-inc-map/0/new.json 2026-02-19T17:13:23.749 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:23.757 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-19T17:13:23.758 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCzRJdpNjT2JRAARKu+wOpt6uxPBHrcoWifYw== --osd-uuid 33a330c3-c881-4e79-afb9-4b9810dbc740 2026-02-19T17:13:23.775 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:23.765+0000 7f0cc9d32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:23.776 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:23.769+0000 7f0cc9d32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:23.777 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:23.769+0000 7f0cc9d32a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:23.778 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:23.769+0000 7f0cc9d32a40 -1 bdev(0x5561ed6a2400 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:13:23.778 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:23.769+0000 7f0cc9d32a40 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-19T17:13:24.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-19T17:13:24.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:13:24.497 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:13:24.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:13:24.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:13:24.607 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:13:24.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:13:24.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:13:24.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:13:24.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:13:24.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:13:24.622 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:24.613+0000 7fd11317ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:24.624 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:24.617+0000 7fd11317ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:24.625 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:24.617+0000 7fd11317ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:24.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:13:24.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:24.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:13:24.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:24.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:24.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:24.719 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:24.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:24.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:24.720 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:13:24.825 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:25.036 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:25.029+0000 7fd11317ea40 -1 Falling back to public interface 2026-02-19T17:13:25.676 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:25.669+0000 7fd11317ea40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:13:25.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:25.827 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:25.827 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:25.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:13:25.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:25.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:13:25.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:26.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:26.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:26.932 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:13:26.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:13:26.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:26.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:13:27.144 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1914369656,v1:127.0.0.1:6801/1914369656] [v2:127.0.0.1:6802/1914369656,v1:127.0.0.1:6803/1914369656] exists,up 33a330c3-c881-4e79-afb9-4b9810dbc740 2026-02-19T17:13:27.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 ' 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:13:27.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:27.149 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:13:27.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:13:27.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-19T17:13:27.151 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:13:27.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5e27c6a5-6d7a-4c26-b52b-3054b5659e26 2026-02-19T17:13:27.151 INFO:tasks.workunit.client.0.trial119.stdout:add osd1 5e27c6a5-6d7a-4c26-b52b-3054b5659e26 2026-02-19T17:13:27.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 5e27c6a5-6d7a-4c26-b52b-3054b5659e26' 2026-02-19T17:13:27.152 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:13:27.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC3RJdp/advCRAAKvQMmeov7Cjz1mDrhFyEBg== 2026-02-19T17:13:27.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC3RJdp/advCRAAKvQMmeov7Cjz1mDrhFyEBg=="}' 2026-02-19T17:13:27.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5e27c6a5-6d7a-4c26-b52b-3054b5659e26 -i td/bad-inc-map/1/new.json 2026-02-19T17:13:27.372 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:27.381 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-19T17:13:27.382 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC3RJdp/advCRAAKvQMmeov7Cjz1mDrhFyEBg== --osd-uuid 5e27c6a5-6d7a-4c26-b52b-3054b5659e26 2026-02-19T17:13:27.396 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:27.389+0000 7f127503da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:27.398 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:27.389+0000 7f127503da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:27.399 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:27.393+0000 7f127503da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:27.400 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:27.393+0000 7f127503da40 -1 bdev(0x5639d4e96400 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-19T17:13:27.400 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:27.393+0000 7f127503da40 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-19T17:13:28.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-19T17:13:28.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:13:28.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T17:13:28.019 INFO:tasks.workunit.client.0.trial119.stdout:adding osd1 key to auth repository 2026-02-19T17:13:28.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:13:28.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T17:13:28.310 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:13:28.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:13:28.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:13:28.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:13:28.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:13:28.332 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:28.325+0000 7f87f88a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:28.334 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:28.325+0000 7f87f88a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:28.335 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:28.329+0000 7f87f88a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:28.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T17:13:28.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:28.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:13:28.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:28.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:28.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:28.516 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:28.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:28.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:28.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:13:28.725 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:28.736 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:28.729+0000 7f87f88a5a40 -1 Falling back to public interface 2026-02-19T17:13:29.425 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:29.417+0000 7f87f88a5a40 -1 osd.1 0 log_to_monitors true 2026-02-19T17:13:29.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:29.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:29.726 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:29.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:13:29.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:29.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:13:29.931 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:30.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:30.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:30.933 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:13:30.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:13:30.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:30.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:13:31.145 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4033566995,v1:127.0.0.1:6811/4033566995] [v2:127.0.0.1:6812/4033566995,v1:127.0.0.1:6813/4033566995] exists,up 5e27c6a5-6d7a-4c26-b52b-3054b5659e26 2026-02-19T17:13:31.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:31.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:31.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 ' 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:13:31.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' 2026-02-19T17:13:31.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:13:31.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-19T17:13:31.152 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:13:31.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7c6bf073-79fb-4bca-9e27-91e614260a56 2026-02-19T17:13:31.153 INFO:tasks.workunit.client.0.trial119.stdout:add osd2 7c6bf073-79fb-4bca-9e27-91e614260a56 2026-02-19T17:13:31.153 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 7c6bf073-79fb-4bca-9e27-91e614260a56' 2026-02-19T17:13:31.153 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:13:31.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC7RJdp4wqDCRAAJpHZO7tdf25Q0sq565/Eag== 2026-02-19T17:13:31.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC7RJdp4wqDCRAAJpHZO7tdf25Q0sq565/Eag=="}' 2026-02-19T17:13:31.163 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7c6bf073-79fb-4bca-9e27-91e614260a56 -i td/bad-inc-map/2/new.json 2026-02-19T17:13:31.375 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:13:31.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-19T17:13:31.387 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC7RJdp4wqDCRAAJpHZO7tdf25Q0sq565/Eag== --osd-uuid 7c6bf073-79fb-4bca-9e27-91e614260a56 2026-02-19T17:13:31.402 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:31.393+0000 7f2b874e4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:31.403 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:31.397+0000 7f2b874e4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:31.405 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:31.397+0000 7f2b874e4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:31.405 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:31.397+0000 7f2b874e4a40 -1 bdev(0x559560e1e400 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-19T17:13:31.405 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:31.397+0000 7f2b874e4a40 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-19T17:13:32.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-19T17:13:32.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:13:32.064 INFO:tasks.workunit.client.0.trial119.stdout:adding osd2 key to auth repository 2026-02-19T17:13:32.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T17:13:32.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:13:32.360 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:13:32.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T17:13:32.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f1a5c49d-acda-4ad2-8cf8-860228fbfa3f --auth-supported=none --mon-host=127.0.0.1:46713 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.12028/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:13:32.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:13:32.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:13:32.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:13:32.383 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:32.373+0000 7f2293080a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:32.384 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:32.377+0000 7f2293080a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:32.385 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:32.377+0000 7f2293080a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:32.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T17:13:32.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:32.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:13:32.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:32.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:32.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:32.574 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:32.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:32.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:32.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:13:32.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:32.840 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:32.833+0000 7f2293080a40 -1 Falling back to public interface 2026-02-19T17:13:33.408 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:33.401+0000 7f2293080a40 -1 osd.2 0 log_to_monitors true 2026-02-19T17:13:33.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:33.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:33.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:13:33.788 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:33.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:33.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:13:33.996 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:13:34.998 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:13:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:13:35.203 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1188619863,v1:127.0.0.1:6819/1188619863] [v2:127.0.0.1:6820/1188619863,v1:127.0.0.1:6821/1188619863] exists,up 7c6bf073-79fb-4bca-9e27-91e614260a56 2026-02-19T17:13:35.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:35.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:35.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:35.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-19T17:13:35.412 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-19T17:13:35.412 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-19T17:13:35.682 INFO:tasks.workunit.client.0.trial119.stderr:pool 'foo' already exists 2026-02-19T17:13:35.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:13:36.693 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-19T17:13:36.993 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 min_size to 1 2026-02-19T17:13:37.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-19T17:13:37.298 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 min_size to 2 2026-02-19T17:13:37.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-19T17:13:42.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-19T17:13:42.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-19T17:13:42.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:42.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:13:42.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:42.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:42.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-19T17:13:42.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:42.314 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:42.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:42.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1914369656,v1:127.0.0.1:6801/1914369656] [v2:127.0.0.1:6802/1914369656,v1:127.0.0.1:6803/1914369656] exists,up 33a330c3-c881-4e79-afb9-4b9810dbc740 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:42.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-19T17:13:42.522 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:42.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:42.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:42.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:13:42.731 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4033566995,v1:127.0.0.1:6811/4033566995] [v2:127.0.0.1:6812/4033566995,v1:127.0.0.1:6813/4033566995] exists,up 5e27c6a5-6d7a-4c26-b52b-3054b5659e26 2026-02-19T17:13:42.732 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-19T17:13:42.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:42.734 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:42.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:42.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:13:42.944 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 13 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1188619863,v1:127.0.0.1:6819/1188619863] [v2:127.0.0.1:6820/1188619863,v1:127.0.0.1:6821/1188619863] exists,up 7c6bf073-79fb-4bca-9e27-91e614260a56 2026-02-19T17:13:42.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:42.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:42.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:42.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-19T17:13:42.946 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.625+0000 7f228001c640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.725+0000 7f2282020640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.725+0000 7f2282020640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.833+0000 7f228001c640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:36.885+0000 7f2282020640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:36.989+0000 7f2282020640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:36.989+0000 7f228001c640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.193+0000 7f2282020640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.293+0000 7f2282020640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.293+0000 7f228001c640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.297+0000 7f228001c640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-19T17:13:42.947 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-19T17:13:42.948 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.625+0000 7f228001c640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.725+0000 7f2282020640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.725+0000 7f2282020640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:35.833+0000 7f228001c640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:36.885+0000 7f2282020640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:36.989+0000 7f2282020640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:36.989+0000 7f228001c640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.193+0000 7f2282020640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.293+0000 7f2282020640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.297+0000 7f228001c640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:13:37.297+0000 7f228001c640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-19T17:13:42.949 INFO:tasks.workunit.client.0.trial119.stdout:success 2026-02-19T17:13:42.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-19T17:13:42.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-19T17:13:42.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-19T17:13:42.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-19T17:13:43.186 INFO:tasks.workunit.client.0.trial119.stderr:pool 'foo' does not exist 2026-02-19T17:13:43.196 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-19T17:13:43.197 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:13:43.197 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:13:43.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:13:43.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:13:43.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:13:48.513 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:13:48.513 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-19T17:13:48.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-19T17:13:48.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:13:48.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-19T17:13:48.514 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:13:48.514 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:13:48.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:13:48.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:13:48.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:13:48.520 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:13:48.521 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:13:48.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:13:48.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:13:48.523 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:13:48.523 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:13:48.523 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:13:48.524 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:48.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:13:48.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:13:48.525 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:48.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:13:48.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:13:48.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-19T17:13:48.538 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:13:48.538 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.538 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:48.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.12028 2026-02-19T17:13:48.540 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/bad-inc-map 0 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:13:48.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:13:48.542 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:13:48.542 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:13:48.543 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:13:48.543 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:13:48.544 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:13:48.545 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:13:48.545 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:13:48.546 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:13:48.546 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:13:48.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:48.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:13:48.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:13:48.547 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:48.548 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:13:48.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T17:13:48.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-19T17:13:48.550 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:13:48.550 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.550 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.12028 2026-02-19T17:13:48.550 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.12028 2026-02-19T17:13:48.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:13:48.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:13:48.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-19T17:13:48.553 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T17:13:48.553 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T17:13:48.608 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-19T17:13:48.609 DEBUG:teuthology.orchestra.run.trial119:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-19T17:13:48.660 INFO:tasks.workunit.client.0.trial119.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T17:13:48.666 INFO:tasks.workunit.client.0.trial119.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T17:13:48.666 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:13:48.666 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:13:48.666 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/divergent-priors 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-19T17:13:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-19T17:13:48.668 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-19T17:13:48.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-19T17:13:48.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-19T17:13:48.669 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-19T17:13:48.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-19T17:13:48.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-19T17:13:48.669 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-19T17:13:48.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-19T17:13:48.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-19T17:13:48.670 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-19T17:13:48.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-19T17:13:48.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-19T17:13:48.672 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-19T17:13:48.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none ' 2026-02-19T17:13:48.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-19T17:13:48.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-19T17:13:48.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-19T17:13:48.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:13:48.674 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-19T17:13:48.674 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:TEST_divergent_2 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:TEST_divergent_3 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:TEST_divergent_ec' 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:13:48.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:13:48.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:13:48.678 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:13:48.678 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:13:48.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:13:48.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:13:48.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:13:48.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:13:48.679 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:13:48.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:13:48.680 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:13:48.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:13:48.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:13:48.682 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:13:48.683 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:48.683 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:13:48.684 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:13:48.684 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:13:48.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:13:48.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:13:48.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:13:48.687 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:13:48.687 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.687 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:48.687 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:13:48.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:13:48.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:13:48.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T17:13:48.689 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:13:48.690 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.690 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:48.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.20601 2026-02-19T17:13:48.691 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:13:48.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T17:13:48.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T17:13:48.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:13:48.693 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T17:13:48.693 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-19T17:13:48.693 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-19T17:13:48.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-19T17:13:48.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-19T17:13:48.693 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-19T17:13:48.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.YYb9TpdQuN 2026-02-19T17:13:48.694 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.YYb9TpdQuN bs=512 count=1 2026-02-19T17:13:48.694 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:13:48.695 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:13:48.695 INFO:tasks.workunit.client.0.trial119.stderr:512 bytes copied, 8.7862e-05 s, 5.8 MB/s 2026-02-19T17:13:48.695 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.YYb9TpdQuN 2026-02-19T17:13:48.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.YYb9TpdQuN 2026-02-19T17:13:48.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-19T17:13:48.696 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-19T17:13:48.697 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-19T17:13:48.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-19T17:13:48.698 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:13:48.698 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:13:48.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-19T17:13:48.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T17:13:48.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:13:48.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:13:48.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:13:48.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T17:13:48.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T17:13:48.721 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:13:48.721 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:48.721 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:48.722 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:48.722 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.722 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:48.722 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:48.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:13:48.752 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:13:48.753 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:13:48.754 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:13:48.754 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:13:48.754 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:13:48.754 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:13:48.755 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:13:48.755 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:13:48.755 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:13:48.755 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:13:48.756 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.756 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:48.756 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:13:48.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:13:48.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get fsid 2026-02-19T17:13:48.810 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:13:48.810 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:13:48.810 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:13:48.811 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:13:48.811 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:13:48.811 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:13:48.811 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:13:48.811 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:13:48.812 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:13:48.812 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.812 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:48.812 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:13:48.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:13:48.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get mon_host 2026-02-19T17:13:48.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-19T17:13:48.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T17:13:48.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:13:48.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:13:48.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:13:48.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T17:13:48.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:13:48.981 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:13:48.981 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:48.982 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:48.982 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:48.982 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:48.982 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:48.982 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:48.983 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:13:48.983 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:13:49.005 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-19T17:13:49.005 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-19T17:13:49.005 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:13:49.005 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:13:49.005 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:13:49.005 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:13:49.005 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:49.006 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:13:49.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:13:49.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:13:49.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:13:49.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:13:49.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:13:49.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:13:49.009 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:13:49.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0b9653c9-717f-4bea-9d80-3f2844f633a0 2026-02-19T17:13:49.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0b9653c9-717f-4bea-9d80-3f2844f633a0' 2026-02-19T17:13:49.009 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 0b9653c9-717f-4bea-9d80-3f2844f633a0 2026-02-19T17:13:49.010 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:13:49.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDNRJdpgF8DARAAaemDnFpeiPmmFIVqRclQIg== 2026-02-19T17:13:49.020 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDNRJdpgF8DARAAaemDnFpeiPmmFIVqRclQIg=="}' 2026-02-19T17:13:49.020 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0b9653c9-717f-4bea-9d80-3f2844f633a0 -i td/divergent-priors/0/new.json 2026-02-19T17:13:49.136 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:49.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T17:13:49.145 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDNRJdpgF8DARAAaemDnFpeiPmmFIVqRclQIg== --osd-uuid 0b9653c9-717f-4bea-9d80-3f2844f633a0 2026-02-19T17:13:49.165 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:49.161+0000 7ff91aa46a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:49.167 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:49.161+0000 7ff91aa46a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:49.168 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:49.165+0000 7ff91aa46a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:49.168 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:49.165+0000 7ff91aa46a40 -1 bdev(0x55a78ffc4400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:13:49.168 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:49.165+0000 7ff91aa46a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T17:13:49.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T17:13:49.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:13:49.937 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:13:49.937 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:13:49.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:13:50.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:13:50.061 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:13:50.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:13:50.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:13:50.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:13:50.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:13:50.091 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:50.085+0000 7efea43cfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:50.093 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:50.089+0000 7efea43cfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:50.094 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:50.089+0000 7efea43cfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:50.172 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:50.173 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:50.173 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:13:50.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:50.625 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:50.621+0000 7efea43cfa40 -1 Falling back to public interface 2026-02-19T17:13:51.283 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:51.283 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:51.283 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:51.283 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:13:51.283 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:51.283 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:13:51.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:51.592 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:51.589+0000 7efea43cfa40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:13:52.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:52.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:52.395 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:13:52.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:13:52.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:52.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:13:52.608 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2223825312,v1:127.0.0.1:6801/2223825312] [v2:127.0.0.1:6802/2223825312,v1:127.0.0.1:6803/2223825312] exists,up 0b9653c9-717f-4bea-9d80-3f2844f633a0 2026-02-19T17:13:52.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:52.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:52.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:52.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-19T17:13:52.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-19T17:13:52.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:13:52.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:13:52.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:13:52.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:13:52.614 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:13:52.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6e2724d3-2f32-4139-ad24-0a66f28ef336 2026-02-19T17:13:52.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 6e2724d3-2f32-4139-ad24-0a66f28ef336' 2026-02-19T17:13:52.615 INFO:tasks.workunit.client.0.trial119.stdout:add osd1 6e2724d3-2f32-4139-ad24-0a66f28ef336 2026-02-19T17:13:52.615 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:13:52.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDQRJdp3Ko6JRAAgAcNoo0nexv14rRCM2DZew== 2026-02-19T17:13:52.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDQRJdp3Ko6JRAAgAcNoo0nexv14rRCM2DZew=="}' 2026-02-19T17:13:52.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6e2724d3-2f32-4139-ad24-0a66f28ef336 -i td/divergent-priors/1/new.json 2026-02-19T17:13:52.841 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:52.850 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T17:13:52.851 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDQRJdp3Ko6JRAAgAcNoo0nexv14rRCM2DZew== --osd-uuid 6e2724d3-2f32-4139-ad24-0a66f28ef336 2026-02-19T17:13:52.871 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:52.865+0000 7f4e48792a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:52.872 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:52.869+0000 7f4e48792a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:52.873 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:52.869+0000 7f4e48792a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:52.874 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:52.869+0000 7f4e48792a40 -1 bdev(0x55cdafb38400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T17:13:52.874 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:52.869+0000 7f4e48792a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T17:13:53.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T17:13:53.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:13:53.548 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T17:13:53.548 INFO:tasks.workunit.client.0.trial119.stdout:adding osd1 key to auth repository 2026-02-19T17:13:53.548 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:13:53.835 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:13:53.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T17:13:53.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:13:53.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:13:53.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:13:53.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:13:53.863 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:53.861+0000 7f001bdd6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:53.865 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:53.861+0000 7f001bdd6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:53.866 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:53.861+0000 7f001bdd6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:54.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T17:13:54.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:54.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:13:54.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:54.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:54.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:54.055 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:54.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:54.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:54.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:13:54.197 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:54.193+0000 7f001bdd6a40 -1 Falling back to public interface 2026-02-19T17:13:54.261 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:54.834 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:54.829+0000 7f001bdd6a40 -1 osd.1 0 log_to_monitors true 2026-02-19T17:13:55.263 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:55.263 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:55.263 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:13:55.264 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:55.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:55.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:13:55.477 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4199161716,v1:127.0.0.1:6811/4199161716] [v2:127.0.0.1:6812/4199161716,v1:127.0.0.1:6813/4199161716] exists,up 6e2724d3-2f32-4139-ad24-0a66f28ef336 2026-02-19T17:13:55.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:55.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:55.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:55.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-19T17:13:55.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-19T17:13:55.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:13:55.479 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:13:55.480 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:13:55.480 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:13:55.480 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:13:55.480 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:55.480 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:13:55.480 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:13:55.481 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:13:55.482 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=34e0e9d9-2229-40e1-b112-30cb471c9ba9 2026-02-19T17:13:55.482 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 34e0e9d9-2229-40e1-b112-30cb471c9ba9' 2026-02-19T17:13:55.482 INFO:tasks.workunit.client.0.trial119.stdout:add osd2 34e0e9d9-2229-40e1-b112-30cb471c9ba9 2026-02-19T17:13:55.482 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:13:55.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDTRJdpdPlzHRAApqjNaB5agyr2fhXBfvGxPg== 2026-02-19T17:13:55.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDTRJdpdPlzHRAApqjNaB5agyr2fhXBfvGxPg=="}' 2026-02-19T17:13:55.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 34e0e9d9-2229-40e1-b112-30cb471c9ba9 -i td/divergent-priors/2/new.json 2026-02-19T17:13:55.711 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:13:55.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T17:13:55.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTRJdpdPlzHRAApqjNaB5agyr2fhXBfvGxPg== --osd-uuid 34e0e9d9-2229-40e1-b112-30cb471c9ba9 2026-02-19T17:13:55.749 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:55.745+0000 7fb661ef5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:55.751 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:55.745+0000 7fb661ef5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:55.752 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:55.749+0000 7fb661ef5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:55.752 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:55.749+0000 7fb661ef5a40 -1 bdev(0x55fc50dd0400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T17:13:55.753 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:55.749+0000 7fb661ef5a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T17:13:56.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T17:13:56.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:13:56.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T17:13:56.395 INFO:tasks.workunit.client.0.trial119.stdout:adding osd2 key to auth repository 2026-02-19T17:13:56.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:13:56.680 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:13:56.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T17:13:56.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:13:56.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:13:56.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:13:56.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:13:56.710 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:56.705+0000 7fa19befaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:56.711 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:56.709+0000 7fa19befaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:56.713 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:56.709+0000 7fa19befaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:13:56.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T17:13:56.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:13:56.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:13:56.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:13:56.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:13:56.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:56.898 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:13:56.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:13:56.899 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:56.899 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:13:57.069 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:57.065+0000 7fa19befaa40 -1 Falling back to public interface 2026-02-19T17:13:57.113 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:57.691 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:13:57.689+0000 7fa19befaa40 -1 osd.2 0 log_to_monitors true 2026-02-19T17:13:58.115 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:58.115 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:58.115 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:13:58.116 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:13:58.116 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:58.116 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:13:58.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:13:59.340 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:13:59.340 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:13:59.340 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:13:59.340 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:13:59.340 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:13:59.340 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:13:59.552 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2886172056,v1:127.0.0.1:6819/2886172056] [v2:127.0.0.1:6820/2886172056,v1:127.0.0.1:6821/2886172056] exists,up 34e0e9d9-2229-40e1-b112-30cb471c9ba9 2026-02-19T17:13:59.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:13:59.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:13:59.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:13:59.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-19T17:13:59.844 INFO:tasks.workunit.client.0.trial119.stderr:noout is set 2026-02-19T17:13:59.854 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-19T17:14:00.149 INFO:tasks.workunit.client.0.trial119.stderr:noin is set 2026-02-19T17:14:00.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-19T17:14:00.452 INFO:tasks.workunit.client.0.trial119.stderr:nodown is set 2026-02-19T17:14:00.462 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-19T17:14:00.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-19T17:14:00.709 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' already exists 2026-02-19T17:14:00.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:14:01.720 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-19T17:14:01.988 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 size to 3 2026-02-19T17:14:01.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-19T17:14:02.291 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 min_size to 2 2026-02-19T17:14:02.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-19T17:14:02.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:14:02.304 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:14:02.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:14:02.522 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:14:02.522 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:14:02.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:14:02.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:02.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:14:02.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-19T17:14:02.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-19T17:14:02.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-19T17:14:02.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:02.609 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:14:02.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-19T17:14:02.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-19T17:14:02.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-19T17:14:02.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:02.692 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:14:02.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-19T17:14:02.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-19T17:14:02.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574851' 2026-02-19T17:14:02.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:02.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-19T17:14:02.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:02.777 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:14:02.778 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-19T17:14:02.778 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:02.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-19T17:14:02.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-19T17:14:02.779 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836484 2026-02-19T17:14:02.780 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:14:02.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-19T17:14:02.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:14:03.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:14:04.000 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:14:04.215 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-19T17:14:04.215 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:04.216 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-19T17:14:04.216 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:04.218 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:14:04.218 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-19T17:14:04.218 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:04.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-19T17:14:04.220 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 38654705668 2026-02-19T17:14:04.221 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-19T17:14:04.221 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:14:04.435 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-19T17:14:04.435 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:04.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-19T17:14:04.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:04.437 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:14:04.438 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-19T17:14:04.438 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:04.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-19T17:14:04.440 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-19T17:14:04.440 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 55834574851 2026-02-19T17:14:04.440 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:14:04.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-19T17:14:04.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-19T17:14:04.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:14:04.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:14:04.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:14:04.655 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:14:04.656 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:14:04.656 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:14:04.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:14:04.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:14:04.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:14:04.753 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:14:04.753 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:14:04.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:14:04.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:14:04.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:14:04.754 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:14:04.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:14:04.964 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:14:04.964 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:14:04.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:14:04.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:04.965 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:14:05.045 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-19T17:14:05.046 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-19T17:14:05.046 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-19T17:14:05.046 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:05.046 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:14:05.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-19T17:14:05.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-19T17:14:05.127 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-19T17:14:05.127 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:05.127 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:14:05.208 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-19T17:14:05.208 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-19T17:14:05.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574854' 2026-02-19T17:14:05.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:05.210 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-19T17:14:05.210 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:05.210 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:14:05.211 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-19T17:14:05.211 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:05.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-19T17:14:05.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-19T17:14:05.213 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836487 2026-02-19T17:14:05.213 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:14:05.426 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-19T17:14:05.426 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:05.427 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-19T17:14:05.427 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:05.428 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:14:05.429 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-19T17:14:05.429 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:05.430 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-19T17:14:05.430 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-19T17:14:05.430 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 38654705670 2026-02-19T17:14:05.431 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:14:05.651 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-19T17:14:05.652 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:05.652 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574854 2026-02-19T17:14:05.652 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:05.653 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:14:05.654 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-19T17:14:05.654 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:05.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574854 2026-02-19T17:14:05.656 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 55834574854 2026-02-19T17:14:05.656 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-19T17:14:05.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:14:05.872 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-19T17:14:05.872 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:14:05.873 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:05.873 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:06.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:14:06.356 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:06.356 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:06.356 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:06.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:14:06.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:14:06.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:14:06.632 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-19T17:14:06.632 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-19T17:14:06.831 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:14:06.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-19T17:14:06.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-19T17:14:06.842 INFO:tasks.workunit.client.0.trial119.stdout:primary and soon to be divergent is 1 2026-02-19T17:14:06.842 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-19T17:14:07.046 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:14:07.046 INFO:tasks.workunit.client.0.trial119.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T17:14:01.628179+0000 0'0 26:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:04:08.861253+0000 0 0 2026-02-19T17:14:07.046 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:14:07.046 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:14:07.046 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:14:07.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-19T17:14:07.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-19T17:14:07.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-19T17:14:07.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-19T17:14:07.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-19T17:14:07.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-19T17:14:07.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-19T17:14:07.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-19T17:14:07.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-19T17:14:07.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-19T17:14:07.057 INFO:tasks.workunit.client.0.trial119.stdout:writing initial objects 2026-02-19T17:14:07.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-19T17:14:07.058 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-19T17:14:07.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.226 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.226 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.337 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.337 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.391 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.391 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.440 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.440 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.493 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.493 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.633 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.689 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.717 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.745 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.745 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.829 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.829 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.857 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.857 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.885 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.885 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.954 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.954 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:07.978 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:07.978 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.063 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.063 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.116 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.116 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.145 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.173 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.173 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.201 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.201 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.257 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.257 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.284 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.284 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.397 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.397 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.452 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.453 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.480 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.509 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.509 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.537 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.537 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.565 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.565 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.593 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.593 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.621 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.621 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.761 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.761 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.818 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.870 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.870 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.925 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:08.981 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:08.982 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.029 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.029 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.085 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.086 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.226 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.256 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.256 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.397 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.397 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.453 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.453 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.510 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.510 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.538 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.538 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.566 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.566 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.705 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.705 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.762 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.762 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-19T17:14:09.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:09.820 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:14:09.820 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-19T17:14:09.820 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:14:09.820 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:14:09.820 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:14:09.820 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:14:09.821 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:14:09.821 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:14:09.821 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:14:09.821 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:14:09.821 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:14:09.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:14:09.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:14:09.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:14:09.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:14:09.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:14:09.892 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:14:10.109 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:14:10.110 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:14:10.110 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:14:10.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:14:10.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:10.110 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:14:10.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-19T17:14:10.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-19T17:14:10.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-19T17:14:10.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:10.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:14:10.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-19T17:14:10.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-19T17:14:10.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-19T17:14:10.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:10.278 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:14:10.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-19T17:14:10.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-19T17:14:10.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-55834574857' 2026-02-19T17:14:10.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:10.361 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-19T17:14:10.361 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:10.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:14:10.362 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-19T17:14:10.362 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:10.363 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-19T17:14:10.363 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836490 2026-02-19T17:14:10.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-19T17:14:10.364 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:14:10.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-19T17:14:10.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:14:11.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:14:11.587 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:14:11.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-19T17:14:11.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:11.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705673 2026-02-19T17:14:11.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:11.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:14:11.803 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-19T17:14:11.803 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:11.804 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705673 2026-02-19T17:14:11.804 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 38654705673 2026-02-19T17:14:11.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-19T17:14:11.805 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:14:12.020 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705673 2026-02-19T17:14:12.021 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:12.021 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574857 2026-02-19T17:14:12.021 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:12.022 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:14:12.023 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-19T17:14:12.023 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:12.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574857 2026-02-19T17:14:12.025 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 55834574857 2026-02-19T17:14:12.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-19T17:14:12.025 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:14:12.247 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-19T17:14:12.247 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:14:12.248 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:12.248 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:12.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:14:12.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:12.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:12.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:12.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:12.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:12.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:12.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:12.740 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:14:12.741 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:12.741 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:12.742 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:13.020 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:14:13.020 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:14:13.020 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:14:13.021 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-19T17:14:13.021 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T17:14:13.021 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T17:14:13.021 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T17:14:13.021 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T17:14:13.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-19T17:14:13.235 INFO:tasks.workunit.client.0.trial119.stdout:blackholing osds 0 2 2026-02-19T17:14:13.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-19T17:14:13.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-19T17:14:13.433 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:14:13.433 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T17:14:01.628179+0000 26'100 26:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:04:08.861253+0000 0 0 2026-02-19T17:14:13.433 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:14:13.434 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:14:13.434 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:14:13.442 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:13.443 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-19T17:14:13.443 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:14:13.443 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:14:13.443 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:14:13.443 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:13.444 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:13.444 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:14:13.444 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-19T17:14:13.444 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T17:14:13.498 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:14:13.498 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:14:13.498 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:14:13.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:13.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-19T17:14:13.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:14:13.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:14:13.504 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:14:13.504 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:13.505 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:13.505 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:14:13.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-19T17:14:13.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T17:14:13.566 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:14:13.567 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:14:13.567 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:14:13.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-19T17:14:13.572 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-19T17:14:13.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-19T17:14:13.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-19T17:14:13.574 INFO:tasks.workunit.client.0.trial119.stdout:writing divergent object 2026-02-19T17:14:13.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-19T17:14:13.574 INFO:tasks.workunit.client.0.trial119.stdout:create missing divergent object 2026-02-19T17:14:13.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-19T17:14:13.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-19T17:14:13.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-19T17:14:13.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.YYb9TpdQuN 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=test 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=existing_99 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/divergent-priors 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-19T17:14:13.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-19T17:14:13.578 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-19T17:14:13.578 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds test existing_99 2026-02-19T17:14:13.578 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-19T17:14:13.578 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-19T17:14:13.578 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-19T17:14:13.578 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-19T17:14:13.786 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-19T17:14:13.787 INFO:tasks.workunit.client.0.trial119.stderr:0 2026-02-19T17:14:13.787 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:14:13.787 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-19T17:14:13.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0' '2') 2026-02-19T17:14:13.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-19T17:14:13.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-19T17:14:13.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-19T17:14:13.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-19T17:14:13.788 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/divergent-priors/1/type 2026-02-19T17:14:13.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-19T17:14:13.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-19T17:14:13.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-19T17:14:13.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-19T17:14:13.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-19T17:14:13.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-19T17:14:13.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-19T17:14:13.790 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-19T17:14:13.791 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:14:13.791 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:14:13.791 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:14:13.791 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:13.791 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:13.791 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:14:13.791 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.20601/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-19T17:14:13.851 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-19T17:14:13.851 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-19T17:14:13.852 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-19T17:14:13.852 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-19T17:14:13.852 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:14:13.852 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:14:13.852 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:14:13.852 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:13.852 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:13.853 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:14:13.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-19T17:14:13.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.1.asok injectdataerr test existing_99 2026-02-19T17:14:13.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-19T17:14:13.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-19T17:14:23.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-19T17:14:23.959 INFO:tasks.workunit.client.0.trial119.stderr:rados: no process found 2026-02-19T17:14:23.959 INFO:tasks.workunit.client.0.trial119.stdout:killing all the osds 2026-02-19T17:14:23.959 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-19T17:14:23.959 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-19T17:14:24.158 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:14:24.158 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-19T17:14:13.930343+0000 26'101 26:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:04:08.861253+0000 0 0 2026-02-19T17:14:24.158 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:14:24.158 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:14:24.159 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:14:24.167 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-19T17:14:24.167 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:14:24.168 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:14:24.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:14:24.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:14:24.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:14:24.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:14:24.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-19T17:14:24.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-19T17:14:24.539 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:14:24.548 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-19T17:14:24.548 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-19T17:14:24.825 INFO:tasks.workunit.client.0.trial119.stderr:osd.1 is already down. 2026-02-19T17:14:24.834 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-19T17:14:24.835 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-19T17:14:25.113 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already down. 2026-02-19T17:14:25.124 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:25.124 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-19T17:14:25.418 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already out. 2026-02-19T17:14:25.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:25.430 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-19T17:14:25.690 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already out. 2026-02-19T17:14:25.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-19T17:14:25.700 INFO:tasks.workunit.client.0.trial119.stdout:bringing up non_divergent 0 2 2026-02-19T17:14:25.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-19T17:14:25.901 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:14:25.901 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-19T17:14:13.930343+0000 26'101 26:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:04:08.861253+0000 0 0 2026-02-19T17:14:25.901 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:14:25.901 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:14:25.901 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:14:25.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:25.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-19T17:14:25.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:14:25.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:14:25.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:14:25.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:14:25.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:14:25.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:14:25.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:14:25.915 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:14:25.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:14:25.917 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:14:25.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:14:25.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:14:25.918 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T17:14:25.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:14:25.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:14:25.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:14:25.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:14:25.932 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:25.928+0000 7ff647167a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:14:25.933 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:25.928+0000 7ff647167a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:14:25.934 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:25.928+0000 7ff647167a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:14:26.128 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:14:26.128 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:14:26.129 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:14:26.129 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:14:26.129 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:14:26.129 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:14:26.129 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:14:26.130 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:14:26.131 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:14:26.131 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:14:26.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:14:26.381 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:26.376+0000 7ff647167a40 -1 Falling back to public interface 2026-02-19T17:14:27.061 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:27.056+0000 7ff647167a40 -1 osd.0 26 log_to_monitors true 2026-02-19T17:14:27.340 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:14:27.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:14:27.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:14:27.341 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:14:27.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:14:27.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:14:27.552 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up out weight 0 up_from 33 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/1063636528,v1:127.0.0.1:6801/1063636528] [v2:127.0.0.1:6802/1063636528,v1:127.0.0.1:6803/1063636528] exists,up 0b9653c9-717f-4bea-9d80-3f2844f633a0 2026-02-19T17:14:27.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:14:27.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:14:27.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:14:27.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:27.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:27.553 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:14:27.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:14:27.555 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:14:27.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:14:27.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:14:27.555 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T17:14:27.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:14:27.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:14:27.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:14:27.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:14:27.578 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:27.572+0000 7f509ef36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:14:27.579 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:27.572+0000 7f509ef36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:14:27.580 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:27.576+0000 7f509ef36a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:14:27.772 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:14:27.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:14:27.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:14:27.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:14:27.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:14:27.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:14:27.773 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:14:27.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:14:27.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:14:27.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:14:27.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:14:27.997 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:27.992+0000 7f509ef36a40 -1 Falling back to public interface 2026-02-19T17:14:28.661 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:14:28.656+0000 7f509ef36a40 -1 osd.2 26 log_to_monitors true 2026-02-19T17:14:28.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:14:28.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:14:28.986 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:14:28.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:14:28.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:14:28.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:14:29.201 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/1561715132,v1:127.0.0.1:6811/1561715132] [v2:127.0.0.1:6812/1561715132,v1:127.0.0.1:6813/1561715132] exists,up 34e0e9d9-2229-40e1-b112-30cb471c9ba9 2026-02-19T17:14:29.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:14:29.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:14:29.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:14:29.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:29.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-19T17:14:29.449 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already in. 2026-02-19T17:14:29.458 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:29.458 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-19T17:14:29.732 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already in. 2026-02-19T17:14:29.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:14:29.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-19T17:14:29.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:14:29.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:14:29.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:14:29.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:14:29.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:14:29.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:14:29.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:14:29.808 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:14:30.023 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:14:30.024 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:14:30.024 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:14:30.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:14:30.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:30.024 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:14:30.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-19T17:14:30.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-19T17:14:30.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771' 2026-02-19T17:14:30.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:30.108 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:14:30.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T17:14:30.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-19T17:14:30.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T17:14:30.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-19T17:14:30.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:14:30.170 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:14:30.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-19T17:14:30.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-19T17:14:30.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-141733920771 2-150323855363' 2026-02-19T17:14:30.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:30.249 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-141733920771 2026-02-19T17:14:30.249 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:30.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:14:30.250 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920771 2026-02-19T17:14:30.251 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:30.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920771 2026-02-19T17:14:30.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 141733920771' 2026-02-19T17:14:30.253 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 141733920771 2026-02-19T17:14:30.253 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:14:30.460 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 141733920771 2026-02-19T17:14:30.460 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:14:31.461 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:14:31.461 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:14:31.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920771 -lt 141733920771 2026-02-19T17:14:31.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:14:31.677 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-150323855363 2026-02-19T17:14:31.677 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:14:31.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:14:31.679 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-19T17:14:31.679 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:14:31.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-19T17:14:31.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-19T17:14:31.681 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 150323855363 2026-02-19T17:14:31.681 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:14:31.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-19T17:14:31.897 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:14:31.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:31.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:32.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:14:32.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:32.180 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:32.180 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:32.181 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:32.181 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:32.181 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:32.181 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:32.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:32.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:32.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:32.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:32.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:32.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T17:14:32.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T17:14:32.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T17:14:32.664 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:32.664 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T17:14:32.764 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:32.764 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:32.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:32.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:32.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:32.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:32.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:32.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:32.979 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:32.979 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:32.979 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:32.980 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:33.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:33.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:33.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:33.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:33.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:33.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:33.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:33.265 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:33.265 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:33.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:33.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:33.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T17:14:33.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:33.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T17:14:33.755 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:33.756 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:33.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:33.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:33.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:33.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:33.757 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:33.757 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:33.968 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:33.968 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:33.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:33.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:34.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:34.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:34.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:34.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:34.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:34.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:34.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:34.254 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:34.254 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:34.534 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:34.534 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:34.534 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T17:14:34.534 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:34.534 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T17:14:34.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:34.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:34.936 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:34.936 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:34.936 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:34.936 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:34.937 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:34.937 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:35.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:35.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:35.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:35.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:35.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:35.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:35.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:35.419 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:35.419 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:35.419 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:35.419 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:35.419 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:35.419 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:35.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:35.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:35.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T17:14:35.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:35.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T17:14:36.510 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:36.510 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:36.511 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:36.511 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:36.511 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:36.512 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:36.512 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:36.512 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:36.720 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:36.720 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:36.721 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:36.721 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:37.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:37.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:37.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:37.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:37.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:37.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:37.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:37.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:37.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:37.287 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:37.287 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:37.287 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T17:14:37.287 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:37.287 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T17:14:38.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:38.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:38.888 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:38.888 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:38.888 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:38.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:38.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:38.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:39.104 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:39.105 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:39.105 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:39.105 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:39.391 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:39.392 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:39.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:39.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:39.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T17:14:39.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:39.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T17:14:42.873 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:42.873 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:42.874 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:42.874 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:42.874 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:42.874 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:42.874 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:42.874 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:43.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:43.088 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:43.089 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:43.089 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:43.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:43.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:43.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:43.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:43.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:43.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:43.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:43.375 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:43.375 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:43.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:43.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:43.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T17:14:43.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:43.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T17:14:50.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:50.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:50.063 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:50.063 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:50.063 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:50.063 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:50.064 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:50.064 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:50.276 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:50.276 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:50.277 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:50.277 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:50.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:50.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:50.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:50.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:50.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:50.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:50.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:50.561 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:50.561 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:50.839 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:50.839 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:50.839 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T17:14:50.839 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:14:50.839 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T17:14:58.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:14:58.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:14:58.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:14:58.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:14:58.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:14:58.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:14:58.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:14:58.141 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:14:58.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:14:58.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:14:58.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:14:58.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:14:58.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:14:58.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:14:58.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:14:58.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:14:58.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:14:58.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:14:58.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:14:58.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:14:58.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:14:58.927 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:14:58.927 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:14:58.927 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T17:14:58.927 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T17:14:59.202 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_fingerprint": "407580fd-7a06-42bf-a966-51de9cb9d25d", 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "version": "20.3.0-5336-g802bf111", 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "commit": "802bf111cd55e57f5842153d7ba2b8b964aa818a", 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "timestamp": "2026-02-19T17:14:59.199077+0000", 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "tag": "", 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "health": { 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "status": "HEALTH_WARN", 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "checks": { 2026-02-19T17:14:59.203 INFO:tasks.workunit.client.0.trial119.stdout: "OSDMAP_FLAGS": { 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "count": 17 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [], 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "OSD_DOWN": { 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:14:59.204 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: "message": "1 osds down", 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: "message": "osd.1 (root=default,host=trial119) is down" 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:14:59.205 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: "PG_DEGRADED": { 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.206 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: "mutes": [] 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_first_committed": 1, 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_last_committed": 1, 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: "monmap": { 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:14:59.207 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:13:48.711460Z", 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:13:48.711460Z", 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release": 20, 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release_name": "tentacle", 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "election_strategy": 1, 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "disallowed_leaders": "", 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": false, 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "tiebreaker_mon": "", 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "removed_ranks": "", 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "features": { 2026-02-19T17:14:59.208 INFO:tasks.workunit.client.0.trial119.stdout: "persistent": [ 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "kraken", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "luminous", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "mimic", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap-prune", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "nautilus", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "octopus", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "pacific", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "elector-pinging", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "quincy", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "reef", 2026-02-19T17:14:59.209 INFO:tasks.workunit.client.0.trial119.stdout: "squid", 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "tentacle", 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "nvmeof_beacon_diff" 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "optional": [] 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "mons": [ 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "rank": 0, 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "name": "a", 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.210 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115", 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 0 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: "priority": 0, 2026-02-19T17:14:59.211 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 0, 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: "time_added": "2026-02-19T17:13:48:711458+0000", 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: "crush_location": [] 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: "quorum": [ 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: 0 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap": { 2026-02-19T17:14:59.212 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 39, 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:13:48.790970+0000", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:14:29.776136+0000", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "last_up_change": "2026-02-19T17:14:28.814763+0000", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "last_in_change": "2026-02-19T17:14:29.673087+0000", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "flags_num": 5800384, 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "flags_set": [ 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "nodown", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "noin", 2026-02-19T17:14:59.213 INFO:tasks.workunit.client.0.trial119.stdout: "noout", 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "pglog_hardlimit", 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snapdirs", 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "recovery_deletes", 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "sortbitwise" 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "crush_version": 9, 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_snapshot": "", 2026-02-19T17:14:59.214 INFO:tasks.workunit.client.0.trial119.stdout: "pool_max": 1, 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "max_osd": 3, 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "require_min_compat_client": "luminous", 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "min_compat_client": "jewel", 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "require_osd_release": "tentacle", 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "allow_crimson": false, 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "pools": [ 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "pool_name": "test", 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "create_time": "2026-02-19T17:14:00.625261+0000", 2026-02-19T17:14:59.215 INFO:tasks.workunit.client.0.trial119.stdout: "flags": 1, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "flags_names": "hashpspool", 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "size": 3, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "min_size": 2, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "crush_rule": 0, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_count": 0, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_target": 0, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "is_stretch_pool": false, 2026-02-19T17:14:59.216 INFO:tasks.workunit.client.0.trial119.stdout: "object_hash": 2, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "pg_autoscale_mode": "off", 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num": 1, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num": 1, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num_target": 1, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_target": 1, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_pending": 1, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "last_pg_merge_meta": { 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "source_pgid": "0.0", 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "ready_epoch": 0, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_started": 0, 2026-02-19T17:14:59.217 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": 0, 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "source_version": "0'0", 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "target_version": "0'0" 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "last_change": "26", 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend": "0", 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "auid": 0, 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "snap_mode": "selfmanaged", 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "snap_seq": 0, 2026-02-19T17:14:59.218 INFO:tasks.workunit.client.0.trial119.stdout: "snap_epoch": 0, 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "pool_snaps": [], 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps": "[]", 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_bytes": 0, 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_objects": 0, 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "tiers": [], 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "tier_of": -1, 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "read_tier": -1, 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "write_tier": -1, 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "cache_mode": "none", 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_bytes": 0, 2026-02-19T17:14:59.219 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_objects": 0, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_flush_age": 0, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_evict_age": 0, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profile": "", 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_params": { 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "type": "none" 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_period": 0, 2026-02-19T17:14:59.220 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_count": 0, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "use_gmt_hitset": true, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "min_read_recency_for_promote": 0, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "min_write_recency_for_promote": 0, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_search_last_n": 0, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "grade_table": [], 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "stripe_width": 0, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "expected_num_objects": 0, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "fast_read": false, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "nonprimary_shards": "{}", 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "options": {}, 2026-02-19T17:14:59.221 INFO:tasks.workunit.client.0.trial119.stdout: "application_metadata": {}, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "read_balance": { 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "score_type": "Fair distribution", 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "score_acting": 2.9900000095367432, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "score_stable": 2.9900000095367432, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_acting": 2, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_stable": 2, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity_weighted": 1, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity": 1, 2026-02-19T17:14:59.222 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity_weighted": 1 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "osds": [ 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "0b9653c9-717f-4bea-9d80-3f2844f633a0", 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:14:59.223 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 5, 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 26, 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 33, 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 38, 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 27, 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.224 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6800", 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6801", 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.225 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6802", 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6803", 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.226 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6806", 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6807", 2026-02-19T17:14:59.227 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6804", 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.228 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6805", 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1063636528 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6801/1063636528", 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6803/1063636528", 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1063636528", 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1063636528", 2026-02-19T17:14:59.229 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "6e2724d3-2f32-4139-ad24-0a66f28ef336", 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: "up": 0, 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:14:59.230 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 0, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 0, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 9, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 20, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 28, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.231 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:14:59.232 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.233 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.234 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.235 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 4199161716 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/4199161716", 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/4199161716", 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4199161716", 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4199161716", 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: "exists" 2026-02-19T17:14:59.236 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "34e0e9d9-2229-40e1-b112-30cb471c9ba9", 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 13, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 26, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 35, 2026-02-19T17:14:59.237 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 0, 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 29, 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.238 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.239 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:14:59.240 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1561715132 2026-02-19T17:14:59.241 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/1561715132", 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/1561715132", 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1561715132", 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1561715132", 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "osd_xinfo": [ 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.242 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:14:24.480694+0000", 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:13:52.547266+0000", 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:14:24.765694+0000", 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:14:59.243 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:14:25.054585+0000", 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:13:58.683678+0000", 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap": [], 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_items": [], 2026-02-19T17:14:59.244 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_primaries": [], 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "pg_temp": [], 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "primary_temp": [], 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "blocklist": {}, 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "range_blocklist": {}, 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profiles": { 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "default": { 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "m": "2", 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps_queue": [], 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "new_removed_snaps": [], 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "new_purged_snaps": [], 2026-02-19T17:14:59.245 INFO:tasks.workunit.client.0.trial119.stdout: "crush_node_flags": {}, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "device_class_flags": {}, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": { 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_enabled": false, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_bucket_count": 0, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "degraded_stretch_mode": 0, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "recovering_stretch_mode": 0, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_bucket": 0 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "osd_metadata": [ 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6802/1063636528,v1:127.0.0.1:6803/1063636528]", 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:14:59.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:14:59.247 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:13:49.787451Z", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6800/1063636528,v1:127.0.0.1:6801/1063636528]", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1063636528,v1:127.0.0.1:6807/1063636528]", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1063636528,v1:127.0.0.1:6805/1063636528]", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:14:59.248 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/4199161716,v1:127.0.0.1:6813/4199161716]", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:14:59.249 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:14:59.250 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:13:53.448551Z", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/4199161716,v1:127.0.0.1:6811/4199161716]", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4199161716,v1:127.0.0.1:6817/4199161716]", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4199161716,v1:127.0.0.1:6815/4199161716]", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:14:59.251 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/1561715132,v1:127.0.0.1:6813/1561715132]", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:14:59.252 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:14:59.253 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:13:56.293042Z", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/1561715132,v1:127.0.0.1:6811/1561715132]", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1561715132,v1:127.0.0.1:6817/1561715132]", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1561715132,v1:127.0.0.1:6815/1561715132]", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:14:59.254 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_clean_epochs": { 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "min_last_epoch_clean": 0, 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": { 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "per_pool": [] 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "osd_epochs": [ 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 34 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 37 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.255 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_first_committed": 1, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_last_committed": 39, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "crushmap": { 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "devices": [ 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.0", 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.1", 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.2", 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: "types": [ 2026-02-19T17:14:59.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 0, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd" 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "host" 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 2, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "chassis" 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 3, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "rack" 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 4, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "row" 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 5, 2026-02-19T17:14:59.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pdu" 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 6, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pod" 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 7, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "room" 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 8, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "datacenter" 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 9, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "zone" 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 10, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "region" 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "root" 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.258 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "buckets": [ 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "id": -1, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default", 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "id": -2, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default~ssd", 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:14:59.259 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119", 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119~ssd", 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.261 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "rules": [ 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 0, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "replicated_rule", 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_firstn", 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:14:59.262 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "tunables": { 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_tries": 0, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_fallback_tries": 0, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "choose_total_tries": 50, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_descend_once": 1, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_vary_r": 1, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_stable": 1, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "msr_descents": 100, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "msr_collision_tries": 100, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "straw_calc_version": 1, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stdout: "allowed_bucket_algs": 54, 2026-02-19T17:14:59.263 INFO:tasks.workunit.client.0.trial119.stderr:report 2293035862 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "profile": "jewel", 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_tunables": 1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "legacy_tunables": 0, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "minimum_required_version": "jewel", 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables": 1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables2": 1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "has_v2_rules": 0, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables3": 1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "has_v3_rules": 0, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "has_v4_buckets": 1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables5": 1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "has_v5_rules": 0, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "has_msr_rules": 0 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "choose_args": {} 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "fsmap": { 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "btime": "2026-02-19T17:13:48:790743+0000", 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "default_fscid": -1, 2026-02-19T17:14:59.264 INFO:tasks.workunit.client.0.trial119.stdout: "compat": { 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "compat": {}, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "ro_compat": {}, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "incompat": { 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_1": "base v0.20", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_2": "client writeable ranges", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_4": "dir inode in separate object", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_8": "no anchor table", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_9": "file layout v2", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_10": "snaprealm v2", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_11": "minor log segments", 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "feature_flags": { 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "enable_multiple": true, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "ever_enabled_multiple": true 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "standbys": [], 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "filesystems": [] 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_first_committed": 1, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_last_committed": 1, 2026-02-19T17:14:59.265 INFO:tasks.workunit.client.0.trial119.stdout: "auth": { 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 5, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_secrets": 3 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_active": 1, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_unknown": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_osd": 3, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "pool_sum": { 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51200, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 100, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 100, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:14:59.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:14:59.267 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 16, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 16, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "up": 2, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 2, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 0 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum": { 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83836, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2056, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 25, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81702, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488964, 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:14:59.268 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036699136, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2105344, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 415682, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 26047, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83663425 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 1, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum_by_class": { 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "ssd": { 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:14:59.269 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83836, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2056, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 25, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81702, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488964, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036699136, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2105344, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 415682, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 26047, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83663425 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 1, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.270 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "pool_stats": [ 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51200, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 100, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 100, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:14:59.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 1228800, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 153600, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:14:59.272 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 16, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 16, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "up": 2, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 2, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 3 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd_stats": [ 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 141733920777 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 38654705676 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 150323855368 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_state": [ 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded", 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "num": 1 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "pool_pg_unavailable_map": [ 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": "1", 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: "pgs": [] 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_osd": [ 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 1, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 0, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": [ 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": {} 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "servicemap": { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 3, 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:14:57.249333+0000", 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "services": { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "daemons": { 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "summary": "", 2026-02-19T17:14:59.274 INFO:tasks.workunit.client.0.trial119.stdout: "0": { 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "2": { 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_first_committed": 1, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_last_committed": 35, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "logm_first_committed": 1, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "logm_last_committed": 211, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "paxos": { 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 296, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "last_pn": 0, 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: "accepted_pn": 0 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:14:59.275 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:14:59.276 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T17:14:59.276 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-19T17:14:59.276 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-19T17:14:59.276 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-19T17:14:59.276 INFO:tasks.workunit.client.0.trial119.stdout:writing non-divergent object existing_4 2026-02-19T17:14:59.276 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-19T17:14:59.418 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:14:59.418 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:14:29.780331+0000 26'100 39:132 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:26:46.739190+0000 0 0 2026-02-19T17:14:59.418 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:14:59.418 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:14:59.418 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:14:59.427 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-19T17:14:59.427 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-19T17:14:59.428 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:14:59.428 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:14:59.428 INFO:tasks.workunit.client.0.trial119.stderr:1000 bytes (1.0 kB) copied, 1.7762e-05 s, 56.3 MB/s 2026-02-19T17:14:59.449 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-19T17:14:59.450 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery 2026-02-19T17:14:59.450 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-19T17:14:59.654 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:14:59.654 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:14:29.780331+0000 26'100 39:132 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:26:46.739190+0000 0 0 2026-02-19T17:14:59.654 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:14:59.654 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:14:59.654 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:14:59.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:59.664 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-19T17:14:59.664 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:14:59.664 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:14:59.664 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:14:59.664 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:59.664 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:59.664 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:14:59.665 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-19T17:14:59.665 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T17:14:59.729 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:14:59.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-19T17:14:59.736 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-19T17:14:59.736 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:14:59.736 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:14:59.736 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:14:59.736 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:14:59.737 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:14:59.737 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:14:59.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-19T17:14:59.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T17:14:59.792 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:14:59.798 INFO:tasks.workunit.client.0.trial119.stdout:revive divergent 1 2026-02-19T17:14:59.799 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-19T17:14:59.799 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:00.010 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:00.010 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:14:29.780331+0000 26'100 39:132 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:26:46.739190+0000 0 0 2026-02-19T17:15:00.010 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:00.010 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:00.011 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:00.021 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-19T17:15:00.335 INFO:tasks.workunit.client.0.trial119.stderr:noup is set 2026-02-19T17:15:00.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-19T17:15:00.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:00.346 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:15:00.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:15:00.348 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:15:00.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:15:00.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:15:00.349 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:15:00.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:15:00.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:15:00.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:15:00.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:15:00.367 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:00.360+0000 7f46c3812a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:00.369 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:00.364+0000 7f46c3812a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:00.370 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:00.364+0000 7f46c3812a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:00.565 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T17:15:00.565 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-19T17:15:00.726 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:00.720+0000 7f46c3812a40 -1 Falling back to public interface 2026-02-19T17:15:01.325 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:01.320+0000 7f46c3812a40 -1 osd.1 26 log_to_monitors true 2026-02-19T17:15:05.566 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-19T17:15:05.567 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery divergent 2026-02-19T17:15:05.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:05.764 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:05.764 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:14:29.780331+0000 39'101 42:139 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:26:46.739190+0000 0 0 2026-02-19T17:15:05.764 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:05.764 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:05.765 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:05.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-19T17:15:05.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:15:05.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:15:05.774 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:15:05.774 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:05.774 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:05.775 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:15:05.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-19T17:15:05.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T17:15:05.829 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:15:05.835 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-19T17:15:06.157 INFO:tasks.workunit.client.0.trial119.stderr:noup is unset 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:06.169 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:15:06.383 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 33 up_thru 38 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/1063636528,v1:127.0.0.1:6801/1063636528] [v2:127.0.0.1:6802/1063636528,v1:127.0.0.1:6803/1063636528] exists,up 0b9653c9-717f-4bea-9d80-3f2844f633a0 2026-02-19T17:15:06.384 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:15:06.384 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:15:06.384 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:15:06.384 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-19T17:15:06.384 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:15:06.384 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:15:06.385 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:15:06.385 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:15:06.385 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:06.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:06.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:15:06.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:06.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:15:06.593 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 44 up_thru 44 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/3062854687,v1:127.0.0.1:6819/3062854687] [v2:127.0.0.1:6820/3062854687,v1:127.0.0.1:6821/3062854687] exists,up 6e2724d3-2f32-4139-ad24-0a66f28ef336 2026-02-19T17:15:06.593 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:06.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:15:06.802 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/1561715132,v1:127.0.0.1:6811/1561715132] [v2:127.0.0.1:6812/1561715132,v1:127.0.0.1:6813/1561715132] exists,up 34e0e9d9-2229-40e1-b112-30cb471c9ba9 2026-02-19T17:15:06.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:15:06.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:15:06.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:15:06.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:07.002 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:07.002 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:14:29.780331+0000 39'101 42:139 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:26:46.739190+0000 0 0 2026-02-19T17:15:07.002 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:07.002 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:07.002 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:07.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-19T17:15:07.013 INFO:tasks.workunit.client.0.trial119.stdout:wait for peering 2026-02-19T17:15:07.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:07.215 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:07.215 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:14:29.780331+0000 39'101 42:139 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:26:46.739190+0000 0 0 2026-02-19T17:15:07.215 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:07.215 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:07.215 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:07.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.YYb9TpdQuN 2026-02-19T17:15:07.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-19T17:15:07.255 INFO:tasks.workunit.client.0.trial119.stdout:killing divergent 1 2026-02-19T17:15:07.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:07.465 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:07.465 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-19T17:15:06.262810+0000 39'101 45:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:15:07.465 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:07.465 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:07.465 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:07.474 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T17:15:07.474 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:15:07.474 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:15:07.474 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:15:07.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:15:07.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:15:07.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:15:07.582 INFO:tasks.workunit.client.0.trial119.stdout:reviving divergent 1 2026-02-19T17:15:07.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-19T17:15:07.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:07.786 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:07.786 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 2 2 0 0 51688 0 0 17 84 17 active+recovering+degraded 2026-02-19T17:15:06.262810+0000 39'101 45:144 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:15:07.786 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:07.786 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:07.786 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:15:07.798 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:15:07.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:15:07.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:15:07.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:15:07.799 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:15:07.799 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:15:07.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:15:07.801 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:15:07.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:15:07.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:15:07.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:15:07.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:15:07.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:15:07.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:15:07.823 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:07.816+0000 7f0ff6357a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:07.825 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:07.820+0000 7f0ff6357a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:07.826 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:07.820+0000 7f0ff6357a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:08.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:15:08.232 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 44 up_thru 44 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/3062854687,v1:127.0.0.1:6819/3062854687] [v2:127.0.0.1:6820/3062854687,v1:127.0.0.1:6821/3062854687] exists,up 6e2724d3-2f32-4139-ad24-0a66f28ef336 2026-02-19T17:15:08.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:15:08.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:15:08.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:15:08.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-19T17:15:08.277 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:08.272+0000 7f0ff6357a40 -1 Falling back to public interface 2026-02-19T17:15:08.903 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:08.896+0000 7f0ff6357a40 -1 osd.1 46 log_to_monitors true 2026-02-19T17:15:28.234 INFO:tasks.workunit.client.0.trial119.stdout:allowing recovery 2026-02-19T17:15:28.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-19T17:15:28.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:28.429 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:28.429 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-19T17:15:09.426404+0000 46'102 50:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-21T01:48:04.276324+0000 0 0 2026-02-19T17:15:28.429 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:28.429 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:28.430 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:28.438 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-19T17:15:28.438 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T17:15:28.526 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:15:28.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-19T17:15:28.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T17:15:28.609 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:15:28.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-19T17:15:28.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T17:15:28.687 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:15:28.694 INFO:tasks.workunit.client.0.trial119.stdout:reading divergent objects 2026-02-19T17:15:28.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-19T17:15:28.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-19T17:15:28.906 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:28.906 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-19T17:15:09.426404+0000 46'102 50:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:14:00.652961+0000 0'0 2026-02-19T17:14:00.652961+0000 0 0 periodic scrub scheduled @ 2026-02-21T01:48:04.276324+0000 0 0 2026-02-19T17:15:28.906 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:28.907 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:28.907 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:28.916 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-19T17:15:28.917 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-19T17:15:28.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:15:28.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T17:15:28.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:15:28.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T17:15:28.970 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:15:28.970 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T17:15:28.995 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:15:28.995 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T17:15:29.023 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-19T17:15:29.024 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-19T17:15:29.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:15:29.030 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4530.0:1 2026-02-19T17:14:13.591175+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T17:15:29.030 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 20 _merge_object_divergent_entries: keeping 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4530.0:1 2026-02-19T17:14:13.591175+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T17:15:29.030 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:15:29.030 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 26'100 first_divergent_update: 26'101 last_divergent_update: 26'101 2026-02-19T17:15:29.031 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-19T17:15:29.031 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:15:29.031 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 26'101 2026-02-19T17:15:29.031 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4530.0:1 2026-02-19T17:14:13.591175+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T17:15:29.031 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:15:06.256+0000 7f46a5798640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-19T17:15:29.032 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-19T17:15:29.032 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:15:29.034 INFO:tasks.workunit.client.0.trial119.stdout:success 2026-02-19T17:15:29.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-19T17:15:29.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.YYb9TpdQuN 2026-02-19T17:15:29.036 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-19T17:15:29.036 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T17:15:29.036 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T17:15:29.290 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' does not exist 2026-02-19T17:15:29.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-19T17:15:29.300 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:15:29.300 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:15:29.300 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:15:29.300 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:15:29.300 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:15:34.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:15:34.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T17:15:34.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:15:34.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:15:34.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:15:34.615 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:15:34.615 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:15:34.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:15:34.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:15:34.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:15:34.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:15:34.624 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:15:34.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:15:34.625 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:15:34.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:15:34.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:15:34.627 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:15:34.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:15:34.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:15:34.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:15:34.629 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:15:34.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:15:34.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:15:34.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:15:34.651 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:15:34.651 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.652 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.652 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:15:34.654 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:15:34.655 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:15:34.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:15:34.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:15:34.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:15:34.656 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:15:34.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:15:34.657 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:15:34.657 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:15:34.658 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:15:34.658 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:15:34.659 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:15:34.660 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:15:34.660 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:15:34.660 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:15:34.660 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:15:34.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:15:34.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:15:34.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:15:34.663 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:15:34.663 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.663 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:15:34.665 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:15:34.665 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:15:34.665 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T17:15:34.666 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:15:34.666 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.666 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.666 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.20601 2026-02-19T17:15:34.668 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:15:34.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T17:15:34.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:15:34.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T17:15:34.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-19T17:15:34.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-19T17:15:34.669 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-19T17:15:34.669 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-19T17:15:34.670 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-19T17:15:34.670 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:34.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.m8rmDm02Sp bs=512 count=1 2026-02-19T17:15:34.672 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:15:34.672 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:15:34.672 INFO:tasks.workunit.client.0.trial119.stderr:512 bytes copied, 8.67e-05 s, 5.9 MB/s 2026-02-19T17:15:34.672 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:34.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:34.673 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-19T17:15:34.673 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-19T17:15:34.673 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-19T17:15:34.674 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.E5lF87FzMO 2026-02-19T17:15:34.674 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.E5lF87FzMO bs=1000 count=1 2026-02-19T17:15:34.676 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:15:34.676 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:15:34.676 INFO:tasks.workunit.client.0.trial119.stderr:1000 bytes (1.0 kB) copied, 8.3033e-05 s, 12.0 MB/s 2026-02-19T17:15:34.677 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.E5lF87FzMO 2026-02-19T17:15:34.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.E5lF87FzMO 2026-02-19T17:15:34.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-19T17:15:34.678 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-19T17:15:34.678 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:15:34.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T17:15:34.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T17:15:34.708 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:15:34.709 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:15:34.709 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:15:34.709 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:15:34.709 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.709 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.709 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:34.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:15:34.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:15:34.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:15:34.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:15:34.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:15:34.744 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:15:34.745 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:15:34.746 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get fsid 2026-02-19T17:15:34.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:15:34.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:15:34.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:15:34.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:15:34.799 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:15:34.800 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:15:34.800 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:15:34.800 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:15:34.800 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:15:34.800 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.801 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.801 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:15:34.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:15:34.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get mon_host 2026-02-19T17:15:34.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-19T17:15:34.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T17:15:34.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:15:34.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:15:34.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:15:34.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T17:15:34.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:15:34.972 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:15:34.972 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:15:34.972 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:15:34.972 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:15:34.973 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.973 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.973 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:34.973 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:15:34.974 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:15:34.996 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-19T17:15:34.996 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-19T17:15:34.996 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:15:34.996 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:15:34.996 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:15:34.997 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:15:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:15:34.999 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:15:35.000 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=83f0f2cc-cedb-4624-8347-8371d4cb593d 2026-02-19T17:15:35.000 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 83f0f2cc-cedb-4624-8347-8371d4cb593d' 2026-02-19T17:15:35.000 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 83f0f2cc-cedb-4624-8347-8371d4cb593d 2026-02-19T17:15:35.001 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:15:35.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA3RZdpa6hzABAAwV7HlX+9dgPNLghEbRUMmg== 2026-02-19T17:15:35.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA3RZdpa6hzABAAwV7HlX+9dgPNLghEbRUMmg=="}' 2026-02-19T17:15:35.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 83f0f2cc-cedb-4624-8347-8371d4cb593d -i td/divergent-priors/0/new.json 2026-02-19T17:15:35.124 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:35.132 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T17:15:35.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA3RZdpa6hzABAAwV7HlX+9dgPNLghEbRUMmg== --osd-uuid 83f0f2cc-cedb-4624-8347-8371d4cb593d 2026-02-19T17:15:35.152 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:35.147+0000 7f546e9e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:35.153 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:35.147+0000 7f546e9e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:35.154 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:35.147+0000 7f546e9e6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:35.155 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:35.147+0000 7f546e9e6a40 -1 bdev(0x55f7e4280400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:15:35.155 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:35.147+0000 7f546e9e6a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T17:15:35.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T17:15:35.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:15:35.894 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:15:35.894 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:15:35.895 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:15:36.020 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:15:36.021 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:15:36.021 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:15:36.022 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:15:36.022 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:15:36.022 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:15:36.053 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:36.047+0000 7f246e7eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:36.055 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:36.047+0000 7f246e7eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:36.056 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:36.051+0000 7f246e7eea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:36.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:15:36.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:15:36.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:15:36.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:15:36.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:15:36.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:36.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:15:36.136 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:36.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:36.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:15:36.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:15:36.634 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:36.627+0000 7f246e7eea40 -1 Falling back to public interface 2026-02-19T17:15:37.246 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:15:37.246 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:37.246 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:15:37.247 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:15:37.247 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:37.247 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:15:37.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:15:37.578 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:37.571+0000 7f246e7eea40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:15:38.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:15:38.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:38.355 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:15:38.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:15:38.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:38.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:15:38.567 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2515432511,v1:127.0.0.1:6801/2515432511] [v2:127.0.0.1:6802/2515432511,v1:127.0.0.1:6803/2515432511] exists,up 83f0f2cc-cedb-4624-8347-8371d4cb593d 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:15:38.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:15:38.572 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:15:38.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:15:38.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:15:38.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:15:38.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:15:38.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:15:38.574 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:15:38.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f 2026-02-19T17:15:38.575 INFO:tasks.workunit.client.0.trial119.stdout:add osd1 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f 2026-02-19T17:15:38.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f' 2026-02-19T17:15:38.575 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:15:38.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA6RZdpvN2vIhAAjjXd8Ol/753exb9JNvcF+w== 2026-02-19T17:15:38.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA6RZdpvN2vIhAAjjXd8Ol/753exb9JNvcF+w=="}' 2026-02-19T17:15:38.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f -i td/divergent-priors/1/new.json 2026-02-19T17:15:38.806 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:15:38.815 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T17:15:38.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA6RZdpvN2vIhAAjjXd8Ol/753exb9JNvcF+w== --osd-uuid 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f 2026-02-19T17:15:38.837 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:38.831+0000 7fcef9a17a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:38.838 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:38.831+0000 7fcef9a17a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:38.839 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:38.831+0000 7fcef9a17a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:38.840 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:38.831+0000 7fcef9a17a40 -1 bdev(0x565107fb2400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T17:15:38.840 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:38.835+0000 7fcef9a17a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T17:15:39.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T17:15:39.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:15:39.536 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T17:15:39.536 INFO:tasks.workunit.client.0.trial119.stdout:adding osd1 key to auth repository 2026-02-19T17:15:39.537 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:15:39.826 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:15:39.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T17:15:39.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:15:39.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:15:39.829 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:15:39.829 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:15:39.845 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:39.839+0000 7fcac9dfda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:39.847 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:39.839+0000 7fcac9dfda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:39.848 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:39.839+0000 7fcac9dfda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:40.041 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:40.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:15:40.259 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:15:40.290 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:40.283+0000 7fcac9dfda40 -1 Falling back to public interface 2026-02-19T17:15:40.881 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:40.875+0000 7fcac9dfda40 -1 osd.1 0 log_to_monitors true 2026-02-19T17:15:41.260 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:15:41.261 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:41.261 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:15:41.261 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:15:41.261 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:41.261 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:15:41.473 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1156029127,v1:127.0.0.1:6811/1156029127] [v2:127.0.0.1:6812/1156029127,v1:127.0.0.1:6813/1156029127] exists,up 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f 2026-02-19T17:15:41.474 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:15:41.475 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:15:41.476 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:15:41.476 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:15:41.476 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:15:41.477 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:15:41.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=95359fb7-0f74-47b1-90ef-5db52f12e7c0 2026-02-19T17:15:41.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 95359fb7-0f74-47b1-90ef-5db52f12e7c0' 2026-02-19T17:15:41.478 INFO:tasks.workunit.client.0.trial119.stdout:add osd2 95359fb7-0f74-47b1-90ef-5db52f12e7c0 2026-02-19T17:15:41.479 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:15:41.493 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA9RZdpWf82HRAAHIO/GF+4CCXa+eKYvVsDow== 2026-02-19T17:15:41.494 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA9RZdpWf82HRAAHIO/GF+4CCXa+eKYvVsDow=="}' 2026-02-19T17:15:41.494 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 95359fb7-0f74-47b1-90ef-5db52f12e7c0 -i td/divergent-priors/2/new.json 2026-02-19T17:15:41.708 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:15:41.717 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T17:15:41.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA9RZdpWf82HRAAHIO/GF+4CCXa+eKYvVsDow== --osd-uuid 95359fb7-0f74-47b1-90ef-5db52f12e7c0 2026-02-19T17:15:41.738 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:41.731+0000 7f1f976e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:41.739 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:41.731+0000 7f1f976e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:41.740 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:41.735+0000 7f1f976e7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:41.741 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:41.735+0000 7f1f976e7a40 -1 bdev(0x55902bd3e400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T17:15:41.741 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:41.735+0000 7f1f976e7a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T17:15:42.406 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T17:15:42.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:15:42.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T17:15:42.407 INFO:tasks.workunit.client.0.trial119.stdout:adding osd2 key to auth repository 2026-02-19T17:15:42.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:15:42.707 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:15:42.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T17:15:42.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:15:42.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:15:42.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:15:42.708 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:15:42.737 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:42.731+0000 7f72ef13da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:42.739 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:42.731+0000 7f72ef13da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:42.740 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:42.735+0000 7f72ef13da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:15:42.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T17:15:42.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:15:42.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:15:42.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:15:42.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:15:42.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:42.918 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:15:42.919 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:15:42.919 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:42.919 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:15:43.130 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:15:43.142 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:43.135+0000 7f72ef13da40 -1 Falling back to public interface 2026-02-19T17:15:43.761 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:15:43.755+0000 7f72ef13da40 -1 osd.2 0 log_to_monitors true 2026-02-19T17:15:44.131 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:15:44.132 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:44.132 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:15:44.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:15:44.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:44.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:15:44.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:15:45.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:15:45.354 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:15:45.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:15:45.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:15:45.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:15:45.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:15:45.566 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1170360242,v1:127.0.0.1:6819/1170360242] [v2:127.0.0.1:6820/1170360242,v1:127.0.0.1:6821/1170360242] exists,up 95359fb7-0f74-47b1-90ef-5db52f12e7c0 2026-02-19T17:15:45.566 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:15:45.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:15:45.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:15:45.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-19T17:15:45.876 INFO:tasks.workunit.client.0.trial119.stderr:noout is set 2026-02-19T17:15:45.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-19T17:15:46.180 INFO:tasks.workunit.client.0.trial119.stderr:noin is set 2026-02-19T17:15:46.192 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-19T17:15:46.485 INFO:tasks.workunit.client.0.trial119.stderr:nodown is set 2026-02-19T17:15:46.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-19T17:15:46.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-19T17:15:46.743 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' already exists 2026-02-19T17:15:46.752 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:15:47.753 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-19T17:15:48.081 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 size to 3 2026-02-19T17:15:48.092 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-19T17:15:48.386 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 min_size to 2 2026-02-19T17:15:48.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-19T17:15:48.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:15:48.399 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:15:48.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:15:48.616 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:15:48.616 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:15:48.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:15:48.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:48.616 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:15:48.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-19T17:15:48.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-19T17:15:48.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-19T17:15:48.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:48.698 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:15:48.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-19T17:15:48.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-19T17:15:48.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672965' 2026-02-19T17:15:48.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:48.780 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:15:48.860 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-19T17:15:48.860 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-19T17:15:48.860 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672965 2-60129542147' 2026-02-19T17:15:48.860 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:15:48.860 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-19T17:15:48.861 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:15:48.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:15:48.862 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-19T17:15:48.863 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:15:48.864 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-19T17:15:48.864 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836485 2026-02-19T17:15:48.864 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-19T17:15:48.864 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:15:49.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-19T17:15:49.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:15:50.085 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:15:50.085 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:15:50.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836485 2026-02-19T17:15:50.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:15:50.305 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-19T17:15:50.305 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:15:50.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:15:50.307 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-19T17:15:50.307 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:15:50.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-19T17:15:50.308 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 42949672965 2026-02-19T17:15:50.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-19T17:15:50.309 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:15:50.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672965 2026-02-19T17:15:50.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:15:50.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-19T17:15:50.523 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:15:50.523 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:15:50.524 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-19T17:15:50.524 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:15:50.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-19T17:15:50.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-19T17:15:50.526 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542147 2026-02-19T17:15:50.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:15:50.755 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-19T17:15:50.755 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-19T17:15:50.755 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:15:50.755 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:15:50.755 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:15:50.755 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:15:50.756 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:15:50.756 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:15:50.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:15:50.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:15:50.757 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:15:50.859 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:15:50.859 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:15:50.859 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:15:50.859 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:15:50.859 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:15:50.859 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:15:51.079 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:15:51.080 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:15:51.080 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:15:51.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:15:51.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:51.080 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:15:51.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-19T17:15:51.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-19T17:15:51.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-19T17:15:51.163 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:51.163 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:15:51.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-19T17:15:51.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-19T17:15:51.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672967' 2026-02-19T17:15:51.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:51.245 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:15:51.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-19T17:15:51.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-19T17:15:51.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672967 2-60129542150' 2026-02-19T17:15:51.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:15:51.331 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-19T17:15:51.331 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:15:51.333 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:15:51.333 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-19T17:15:51.333 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:15:51.335 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-19T17:15:51.335 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836488 2026-02-19T17:15:51.335 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-19T17:15:51.335 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:15:51.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-19T17:15:51.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:15:51.553 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672967 2026-02-19T17:15:51.554 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:15:51.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:15:51.555 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-19T17:15:51.555 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:15:51.557 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672967 2026-02-19T17:15:51.557 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 42949672967 2026-02-19T17:15:51.557 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-19T17:15:51.557 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:15:51.771 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-19T17:15:51.771 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:15:51.772 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-19T17:15:51.772 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:15:51.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:15:51.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-19T17:15:51.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:15:51.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-19T17:15:51.775 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542150 2026-02-19T17:15:51.776 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-19T17:15:51.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:15:51.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542150 2026-02-19T17:15:51.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:15:52.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:15:52.999 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:15:53.216 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542150 2026-02-19T17:15:53.216 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:15:54.217 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T17:15:54.218 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:15:54.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-19T17:15:54.434 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:15:54.434 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:15:54.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:15:54.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:15:54.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:15:54.719 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:15:54.719 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:15:54.719 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:15:54.719 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:15:54.720 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:15:54.720 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:15:54.931 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:15:54.932 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:15:54.932 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:15:54.932 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:15:55.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:15:55.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:15:55.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:15:55.214 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-19T17:15:55.214 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-19T17:15:55.416 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:55.426 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-19T17:15:55.426 INFO:tasks.workunit.client.0.trial119.stdout:primary and soon to be divergent is 1 2026-02-19T17:15:55.426 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-19T17:15:55.427 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:15:55.630 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:15:55.630 INFO:tasks.workunit.client.0.trial119.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T17:15:47.823197+0000 0'0 28:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:02:26.924688+0000 0 0 2026-02-19T17:15:55.630 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:15:55.631 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:15:55.631 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-19T17:15:55.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-19T17:15:55.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-19T17:15:55.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-19T17:15:55.641 INFO:tasks.workunit.client.0.trial119.stdout:writing initial objects 2026-02-19T17:15:55.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-19T17:15:55.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.777 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.777 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.833 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.833 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.889 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.959 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.959 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:55.987 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:55.987 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.041 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.069 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.070 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.155 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.155 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.240 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.240 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.269 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.270 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.327 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.327 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.383 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.383 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.440 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.440 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.469 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.469 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.751 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.751 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.772 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.772 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.847 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.847 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.873 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.873 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:56.978 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:56.978 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.130 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.130 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.191 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.191 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.211 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.211 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.259 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.259 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.307 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.307 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.335 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.335 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.363 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.363 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.389 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.389 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.419 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.474 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.557 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.558 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.615 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.776 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.776 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.830 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.830 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.886 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.887 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:57.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:57.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.047 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.048 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.069 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.069 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.091 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.091 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.119 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.175 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.176 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-19T17:15:58.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.m8rmDm02Sp 2026-02-19T17:15:58.307 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:15:58.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-19T17:15:58.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:15:58.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:15:58.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:15:58.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:15:58.309 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:15:58.309 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:15:58.309 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:15:58.309 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:15:58.310 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:15:58.379 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:15:58.379 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:15:58.379 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:15:58.379 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:15:58.379 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:15:58.379 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:15:58.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:15:58.587 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:15:58.587 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:15:58.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:15:58.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:58.588 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:15:58.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-19T17:15:58.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-19T17:15:58.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-19T17:15:58.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:58.670 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:15:58.753 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672971 2026-02-19T17:15:58.753 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672971 2026-02-19T17:15:58.753 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672971' 2026-02-19T17:15:58.753 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:15:58.753 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:15:58.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-19T17:15:58.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-19T17:15:58.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-42949672971 2-60129542153' 2026-02-19T17:15:58.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:15:58.838 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-19T17:15:58.838 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:15:58.839 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:15:58.839 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-19T17:15:58.840 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:15:58.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-19T17:15:58.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-19T17:15:58.841 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836491 2026-02-19T17:15:58.842 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:15:59.059 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-19T17:15:59.059 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:16:00.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:16:00.061 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:16:00.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836491 2026-02-19T17:16:00.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:16:00.278 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672971 2026-02-19T17:16:00.279 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:16:00.279 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:16:00.280 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672971 2026-02-19T17:16:00.280 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:16:00.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672971 2026-02-19T17:16:00.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2026-02-19T17:16:00.282 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 42949672971 2026-02-19T17:16:00.282 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:16:00.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672971 -lt 42949672971 2026-02-19T17:16:00.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:16:00.497 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-19T17:16:00.497 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:16:00.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:16:00.498 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-19T17:16:00.499 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:16:00.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-19T17:16:00.500 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542153 2026-02-19T17:16:00.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-19T17:16:00.501 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:16:00.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-19T17:16:00.719 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:16:00.720 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:00.720 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:01.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:16:01.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:01.004 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:01.004 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:01.004 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:01.004 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:01.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:01.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:01.216 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:16:01.216 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:01.217 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:01.217 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:01.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:16:01.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:16:01.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:16:01.503 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-19T17:16:01.503 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T17:16:01.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T17:16:01.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T17:16:01.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T17:16:01.715 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-19T17:16:01.715 INFO:tasks.workunit.client.0.trial119.stdout:blackholing osds 0 2 2026-02-19T17:16:01.715 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-19T17:16:01.715 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:16:01.916 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:16:01.917 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T17:15:47.823197+0000 28'100 28:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:02:26.924688+0000 0 0 2026-02-19T17:16:01.917 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:16:01.917 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:16:01.917 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:16:01.927 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:01.928 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-19T17:16:01.928 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:16:01.928 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:16:01.929 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:16:01.929 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:16:01.929 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:16:01.929 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:16:01.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-19T17:16:01.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T17:16:01.983 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:16:01.983 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:16:01.983 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:16:01.989 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:01.990 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-19T17:16:01.990 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:16:01.990 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:16:01.990 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:16:01.990 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:16:01.990 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:16:01.990 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:16:01.991 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-19T17:16:01.991 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T17:16:02.052 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:16:02.052 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:16:02.052 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:16:02.057 INFO:tasks.workunit.client.0.trial119.stdout:create new divergent objects 2026-02-19T17:16:02.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-19T17:16:02.058 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-19T17:16:02.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:16:02.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:16:02.059 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-19T17:16:02.059 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-19T17:16:02.059 INFO:tasks.workunit.client.0.trial119.stdout:writing divergent objects 2026-02-19T17:16:02.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-19T17:16:02.060 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-19T17:16:02.061 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T17:16:02.061 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T17:16:02.061 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.E5lF87FzMO 2026-02-19T17:16:02.061 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-19T17:16:02.061 INFO:tasks.workunit.client.0.trial119.stdout:remove divergent objects 2026-02-19T17:16:02.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.E5lF87FzMO 2026-02-19T17:16:02.062 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-19T17:16:02.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T17:16:02.063 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-19T17:16:02.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-19T17:16:02.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T17:16:02.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-19T17:16:02.065 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-19T17:16:02.065 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-19T17:16:02.066 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-19T17:16:02.066 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-19T17:16:12.068 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-19T17:16:12.118 INFO:tasks.workunit.client.0.trial119.stderr:rados: no process found 2026-02-19T17:16:12.118 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-19T17:16:12.119 INFO:tasks.workunit.client.0.trial119.stdout:killing all the osds 2026-02-19T17:16:12.119 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:16:12.334 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:16:12.335 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-19T17:15:47.823197+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:02:26.924688+0000 0 0 2026-02-19T17:16:12.335 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:16:12.335 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:16:12.335 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:16:12.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-19T17:16:12.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:16:12.346 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:16:12.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:16:12.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:16:12.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:16:12.455 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:16:12.455 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-19T17:16:12.455 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-19T17:16:12.720 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:16:12.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-19T17:16:12.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-19T17:16:13.007 INFO:tasks.workunit.client.0.trial119.stderr:osd.1 is already down. 2026-02-19T17:16:13.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-19T17:16:13.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-19T17:16:13.293 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already down. 2026-02-19T17:16:13.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:13.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-19T17:16:13.577 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already out. 2026-02-19T17:16:13.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:13.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-19T17:16:13.862 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already out. 2026-02-19T17:16:13.871 INFO:tasks.workunit.client.0.trial119.stdout:bringing up non_divergent 0 2 2026-02-19T17:16:13.872 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-19T17:16:13.872 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:16:14.081 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:16:14.082 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-19T17:15:47.823197+0000 28'106 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:02:26.924688+0000 0 0 2026-02-19T17:16:14.082 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:16:14.082 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:16:14.082 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:16:14.095 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:16:14.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:16:14.097 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:16:14.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:16:14.099 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:16:14.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:16:14.100 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T17:16:14.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:16:14.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:16:14.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:16:14.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:16:14.118 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:14.110+0000 7f02f3f2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:16:14.119 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:14.110+0000 7f02f3f2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:16:14.120 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:14.110+0000 7f02f3f2ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:16:14.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:16:14.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:16:14.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:16:14.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:16:14.555 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:14.545+0000 7f02f3f2ea40 -1 Falling back to public interface 2026-02-19T17:16:15.136 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:15.125+0000 7f02f3f2ea40 -1 osd.0 28 log_to_monitors true 2026-02-19T17:16:15.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:16:15.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:16:15.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:16:15.529 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:16:15.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:16:15.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:16:15.742 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3591656537,v1:127.0.0.1:6801/3591656537] [v2:127.0.0.1:6802/3591656537,v1:127.0.0.1:6803/3591656537] exists,up 83f0f2cc-cedb-4624-8347-8371d4cb593d 2026-02-19T17:16:15.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:16:15.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:16:15.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:16:15.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:15.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-19T17:16:15.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:16:15.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:16:15.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:16:15.749 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:16:15.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:16:15.750 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T17:16:15.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:16:15.751 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:16:15.751 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:16:15.751 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:16:15.769 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:15.757+0000 7efcf0c71a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:16:15.771 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:15.761+0000 7efcf0c71a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:16:15.772 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:15.761+0000 7efcf0c71a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:16:15.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:16:15.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:16:15.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:16:15.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:16:15.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:16:15.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:16:15.967 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:16:15.967 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:16:15.968 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:16:15.968 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:16:16.167 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:16.157+0000 7efcf0c71a40 -1 Falling back to public interface 2026-02-19T17:16:16.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:16:16.754 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:16:16.741+0000 7efcf0c71a40 -1 osd.2 28 log_to_monitors true 2026-02-19T17:16:17.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:16:17.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:16:17.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:16:17.184 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:16:17.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:16:17.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:16:17.401 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/2833814796,v1:127.0.0.1:6811/2833814796] [v2:127.0.0.1:6812/2833814796,v1:127.0.0.1:6813/2833814796] exists,up 95359fb7-0f74-47b1-90ef-5db52f12e7c0 2026-02-19T17:16:17.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:16:17.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:16:17.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:16:17.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:17.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-19T17:16:17.665 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already in. 2026-02-19T17:16:17.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:16:17.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-19T17:16:17.947 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already in. 2026-02-19T17:16:17.957 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:16:17.958 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-19T17:16:17.958 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:16:17.958 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:16:17.958 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:16:17.958 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:16:17.959 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:16:17.959 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:16:17.959 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:16:17.959 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:16:17.959 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:16:18.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:16:18.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:16:18.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:16:18.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:16:18.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:16:18.027 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:16:18.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:16:18.245 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:16:18.246 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:16:18.246 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:16:18.246 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:16:18.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:16:18.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-19T17:16:18.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-19T17:16:18.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-19T17:16:18.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:16:18.332 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:16:18.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T17:16:18.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-19T17:16:18.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T17:16:18.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-19T17:16:18.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:16:18.396 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:16:18.476 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-19T17:16:18.476 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-19T17:16:18.476 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-158913789955' 2026-02-19T17:16:18.476 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:16:18.476 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-19T17:16:18.476 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:16:18.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:16:18.478 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-19T17:16:18.478 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:16:18.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-19T17:16:18.479 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 150323855363 2026-02-19T17:16:18.480 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-19T17:16:18.480 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:16:18.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-19T17:16:18.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:16:19.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:16:19.702 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:16:19.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-19T17:16:19.919 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:16:19.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789955 2026-02-19T17:16:19.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:16:19.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:16:19.921 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-19T17:16:19.921 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:16:19.923 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-19T17:16:19.923 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 158913789955 2026-02-19T17:16:19.923 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-19T17:16:19.924 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:16:20.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-19T17:16:20.153 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:16:20.153 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:20.153 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:20.435 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:16:20.435 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:20.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:20.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:20.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:20.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:20.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:20.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:20.644 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:20.644 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:20.645 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:20.645 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:20.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:20.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T17:16:20.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T17:16:20.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T17:16:20.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:20.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T17:16:21.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:21.028 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:21.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:21.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:21.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:21.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:21.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:21.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:21.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:21.239 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:21.239 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:21.239 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:21.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:21.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:21.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:21.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:21.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:21.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:21.525 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:21.526 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:21.526 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:21.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:21.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:21.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T17:16:21.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:21.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T17:16:22.000 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:22.000 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:22.001 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:22.001 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:22.001 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:22.001 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:22.001 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:22.001 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:22.214 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:22.215 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:22.215 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:22.215 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:22.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:22.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:22.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:22.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:22.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:22.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:22.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:22.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:22.504 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:22.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:22.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:22.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T17:16:22.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:22.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T17:16:23.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:23.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:23.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:23.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:23.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:23.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:23.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:23.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:23.405 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:23.406 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:23.407 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:23.407 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:23.701 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:23.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:23.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:23.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T17:16:23.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:23.986 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T17:16:24.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:24.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:24.788 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:24.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:24.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:24.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:24.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:24.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:25.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:25.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:25.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:25.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:25.285 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:25.563 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:25.563 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:25.563 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T17:16:25.563 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:25.563 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T17:16:27.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:27.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:27.166 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:27.166 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:27.166 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:27.166 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:27.166 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:27.166 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:27.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:27.375 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:27.375 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:27.375 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:27.653 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:27.654 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:27.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:27.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:27.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T17:16:27.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:27.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T17:16:31.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:31.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:31.137 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:31.137 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:31.137 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:31.137 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:31.137 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:31.137 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:31.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:31.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:31.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:31.349 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:31.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:31.624 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:31.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:31.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:31.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T17:16:31.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:31.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T17:16:38.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:38.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:38.315 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:38.316 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:38.316 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:38.316 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:38.316 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:38.316 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:38.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:38.528 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:38.529 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:38.529 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:38.810 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:39.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:39.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:39.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T17:16:39.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:39.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T17:16:46.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:46.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:46.399 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:46.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:46.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:46.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:46.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:46.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:46.614 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:46.615 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:46.615 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:46.615 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:46.895 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:46.895 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:46.895 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:46.895 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:46.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:46.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:46.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:46.896 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:46.896 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:47.178 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:47.178 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:47.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T17:16:47.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T17:16:47.460 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_fingerprint": "7375f1c7-216b-49ce-a68b-49b705c6a911", 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "version": "20.3.0-5336-g802bf111", 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "commit": "802bf111cd55e57f5842153d7ba2b8b964aa818a", 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "timestamp": "2026-02-19T17:16:47.454721+0000", 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "tag": "", 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "health": { 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "status": "HEALTH_WARN", 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "checks": { 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "OSDMAP_FLAGS": { 2026-02-19T17:16:47.461 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "count": 17 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [], 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "OSD_DOWN": { 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "message": "1 osds down", 2026-02-19T17:16:47.462 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: "message": "osd.1 (root=default,host=trial119) is down" 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: "PG_DEGRADED": { 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:16:47.463 INFO:tasks.workunit.client.0.trial119.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.464 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "mutes": [] 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_first_committed": 1, 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_last_committed": 1, 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "monmap": { 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:15:34.698054Z", 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:15:34.698054Z", 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release": 20, 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release_name": "tentacle", 2026-02-19T17:16:47.465 INFO:tasks.workunit.client.0.trial119.stdout: "election_strategy": 1, 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "disallowed_leaders": "", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": false, 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "tiebreaker_mon": "", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "removed_ranks": "", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "features": { 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "persistent": [ 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "kraken", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "luminous", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "mimic", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap-prune", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "nautilus", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "octopus", 2026-02-19T17:16:47.466 INFO:tasks.workunit.client.0.trial119.stdout: "pacific", 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "elector-pinging", 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "quincy", 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "reef", 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "squid", 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "tentacle", 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "nvmeof_beacon_diff" 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "optional": [] 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "mons": [ 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "rank": 0, 2026-02-19T17:16:47.467 INFO:tasks.workunit.client.0.trial119.stdout: "name": "a", 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115", 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 0 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T17:16:47.468 INFO:tasks.workunit.client.0.trial119.stdout: "priority": 0, 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 0, 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: "time_added": "2026-02-19T17:15:34:698052+0000", 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: "crush_location": [] 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: "quorum": [ 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: 0 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap": { 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 40, 2026-02-19T17:16:47.469 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:15:34.779032+0000", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:16:17.989664+0000", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "last_up_change": "2026-02-19T17:16:16.904144+0000", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "last_in_change": "2026-02-19T17:16:17.887178+0000", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "flags_num": 5800384, 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "flags_set": [ 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "nodown", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "noin", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "noout", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "pglog_hardlimit", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snapdirs", 2026-02-19T17:16:47.470 INFO:tasks.workunit.client.0.trial119.stdout: "recovery_deletes", 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "sortbitwise" 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "crush_version": 9, 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_snapshot": "", 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "pool_max": 1, 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "max_osd": 3, 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "require_min_compat_client": "luminous", 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "min_compat_client": "jewel", 2026-02-19T17:16:47.471 INFO:tasks.workunit.client.0.trial119.stdout: "require_osd_release": "tentacle", 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "allow_crimson": false, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "pools": [ 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "pool_name": "test", 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "create_time": "2026-02-19T17:15:46.663510+0000", 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "flags": 1, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "flags_names": "hashpspool", 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "size": 3, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "min_size": 2, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "crush_rule": 0, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_count": 0, 2026-02-19T17:16:47.472 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_target": 0, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "is_stretch_pool": false, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "object_hash": 2, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "pg_autoscale_mode": "off", 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num": 1, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num": 1, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num_target": 1, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_target": 1, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_pending": 1, 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "last_pg_merge_meta": { 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "source_pgid": "0.0", 2026-02-19T17:16:47.473 INFO:tasks.workunit.client.0.trial119.stdout: "ready_epoch": 0, 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_started": 0, 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": 0, 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "source_version": "0'0", 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "target_version": "0'0" 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "last_change": "28", 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend": "0", 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "auid": 0, 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "snap_mode": "selfmanaged", 2026-02-19T17:16:47.474 INFO:tasks.workunit.client.0.trial119.stdout: "snap_seq": 0, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "snap_epoch": 0, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "pool_snaps": [], 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps": "[]", 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_bytes": 0, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_objects": 0, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "tiers": [], 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "tier_of": -1, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "read_tier": -1, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "write_tier": -1, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "cache_mode": "none", 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_bytes": 0, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_objects": 0, 2026-02-19T17:16:47.475 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_flush_age": 0, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_evict_age": 0, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profile": "", 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_params": { 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "type": "none" 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_period": 0, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_count": 0, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "use_gmt_hitset": true, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "min_read_recency_for_promote": 0, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "min_write_recency_for_promote": 0, 2026-02-19T17:16:47.476 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_search_last_n": 0, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "grade_table": [], 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "stripe_width": 0, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "expected_num_objects": 0, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "fast_read": false, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "nonprimary_shards": "{}", 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "options": {}, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "application_metadata": {}, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "read_balance": { 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "score_type": "Fair distribution", 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "score_acting": 2.9900000095367432, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "score_stable": 2.9900000095367432, 2026-02-19T17:16:47.477 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_acting": 2, 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_stable": 2, 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity_weighted": 1, 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity": 1, 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity_weighted": 1 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "osds": [ 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "83f0f2cc-cedb-4624-8347-8371d4cb593d", 2026-02-19T17:16:47.478 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 5, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 35, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 39, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 29, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.479 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6800", 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6801", 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:16:47.480 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6802", 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6803", 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.481 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6806", 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6807", 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.482 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6804", 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6805", 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:16:47.483 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6801/3591656537", 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6803/3591656537", 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3591656537", 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3591656537", 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.484 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f", 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "up": 0, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 0, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 0, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 10, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 22, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 30, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:16:47.485 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.486 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.487 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.488 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.489 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/1156029127", 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/1156029127", 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1156029127", 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1156029127", 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "exists" 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "95359fb7-0f74-47b1-90ef-5db52f12e7c0", 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:16:47.490 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 14, 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 37, 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 0, 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 31, 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.491 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.492 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:16:47.493 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.494 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/2833814796", 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/2833814796", 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2833814796", 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2833814796", 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "osd_xinfo": [ 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:16:12.657463+0000", 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:16:47.495 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:15:38.563978+0000", 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:16:12.946254+0000", 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:16:47.496 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:16:13.232744+0000", 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:15:44.714895+0000", 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap": [], 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_items": [], 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_primaries": [], 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "pg_temp": [], 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "primary_temp": [], 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "blocklist": {}, 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "range_blocklist": {}, 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profiles": { 2026-02-19T17:16:47.497 INFO:tasks.workunit.client.0.trial119.stdout: "default": { 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "m": "2", 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps_queue": [], 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "new_removed_snaps": [], 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "new_purged_snaps": [], 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "crush_node_flags": {}, 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "device_class_flags": {}, 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": { 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_enabled": false, 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_bucket_count": 0, 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "degraded_stretch_mode": 0, 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "recovering_stretch_mode": 0, 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_bucket": 0 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.498 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "osd_metadata": [ 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6802/3591656537,v1:127.0.0.1:6803/3591656537]", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T17:16:47.499 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:15:35.742248Z", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:16:47.500 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6800/3591656537,v1:127.0.0.1:6801/3591656537]", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3591656537,v1:127.0.0.1:6807/3591656537]", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3591656537,v1:127.0.0.1:6805/3591656537]", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.501 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/1156029127,v1:127.0.0.1:6813/1156029127]", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:16:47.502 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:15:39.412735Z", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/1156029127,v1:127.0.0.1:6811/1156029127]", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1156029127,v1:127.0.0.1:6817/1156029127]", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1156029127,v1:127.0.0.1:6815/1156029127]", 2026-02-19T17:16:47.503 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/2833814796,v1:127.0.0.1:6813/2833814796]", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:16:47.504 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:16:47.505 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:15:42.304370Z", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/2833814796,v1:127.0.0.1:6811/2833814796]", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2833814796,v1:127.0.0.1:6817/2833814796]", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2833814796,v1:127.0.0.1:6815/2833814796]", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:16:47.506 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_clean_epochs": { 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "min_last_epoch_clean": 0, 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": { 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "per_pool": [] 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "osd_epochs": [ 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 35 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 38 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.507 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_first_committed": 1, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_last_committed": 40, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "crushmap": { 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "devices": [ 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.0", 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.1", 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.2", 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: "types": [ 2026-02-19T17:16:47.508 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 0, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd" 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "name": "host" 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 2, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "name": "chassis" 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 3, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "name": "rack" 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 4, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "name": "row" 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 5, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pdu" 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.509 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 6, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pod" 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 7, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "name": "room" 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 8, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "name": "datacenter" 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 9, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "name": "zone" 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 10, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "name": "region" 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: "name": "root" 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.510 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "buckets": [ 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "id": -1, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default", 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "id": -2, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default~ssd", 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:16:47.511 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119", 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:16:47.512 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119~ssd", 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:16:47.513 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "rules": [ 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 0, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "replicated_rule", 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_firstn", 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.514 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "tunables": { 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_tries": 0, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_fallback_tries": 0, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "choose_total_tries": 50, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_descend_once": 1, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_vary_r": 1, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_stable": 1, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "msr_descents": 100, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "msr_collision_tries": 100, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "straw_calc_version": 1, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stdout: "allowed_bucket_algs": 54, 2026-02-19T17:16:47.515 INFO:tasks.workunit.client.0.trial119.stderr:report 1349693398 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "profile": "jewel", 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_tunables": 1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "legacy_tunables": 0, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "minimum_required_version": "jewel", 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables": 1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables2": 1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "has_v2_rules": 0, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables3": 1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "has_v3_rules": 0, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "has_v4_buckets": 1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables5": 1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "has_v5_rules": 0, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "has_msr_rules": 0 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "choose_args": {} 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "fsmap": { 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "btime": "2026-02-19T17:15:34:778787+0000", 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "default_fscid": -1, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "compat": { 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "compat": {}, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "ro_compat": {}, 2026-02-19T17:16:47.516 INFO:tasks.workunit.client.0.trial119.stdout: "incompat": { 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_1": "base v0.20", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_2": "client writeable ranges", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_4": "dir inode in separate object", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_8": "no anchor table", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_9": "file layout v2", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_10": "snaprealm v2", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_11": "minor log segments", 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "feature_flags": { 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "enable_multiple": true, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "ever_enabled_multiple": true 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "standbys": [], 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "filesystems": [] 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_first_committed": 1, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_last_committed": 1, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "auth": { 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 5, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "num_secrets": 3 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.517 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_active": 1, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_unknown": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_osd": 3, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "pool_sum": { 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51200, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 100, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 100, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:16:47.518 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.519 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 16, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 16, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "up": 2, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 2, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 0 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum": { 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83864, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2080, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 23, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81704, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488936, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036670464, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2129920, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 422002, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 24099, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83665373 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.520 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum_by_class": { 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "ssd": { 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83864, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2080, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 23, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81704, 2026-02-19T17:16:47.521 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488936, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036670464, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2129920, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 422002, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 24099, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83665373 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: "pool_stats": [ 2026-02-19T17:16:47.522 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51200, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 100, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 100, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:16:47.523 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 1220608, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 153552, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 16, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 16, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "up": 2, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 2, 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 3 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: "osd_stats": [ 2026-02-19T17:16:47.524 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 150323855369 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 42949672974 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 158913789961 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_state": [ 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded", 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "num": 1 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "pool_pg_unavailable_map": [ 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": "1", 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "pgs": [] 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_osd": [ 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.525 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 1, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 0, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": [ 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": {} 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "servicemap": { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 3, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:16:43.241989+0000", 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "services": { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "osd": { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "daemons": { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "summary": "", 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "0": { 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:16:47.526 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "2": { 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_first_committed": 1, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_last_committed": 37, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "logm_first_committed": 1, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "logm_last_committed": 215, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "paxos": { 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 302, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "last_pn": 0, 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: "accepted_pn": 0 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:16:47.527 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:16:47.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T17:16:47.528 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-19T17:16:47.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-19T17:16:47.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-19T17:16:47.528 INFO:tasks.workunit.client.0.trial119.stdout:writing non-divergent object existing_4 2026-02-19T17:16:47.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:16:47.672 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:16:47.672 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:16:17.993385+0000 28'100 40:130 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:26:47.057927+0000 0 0 2026-02-19T17:16:47.672 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:16:47.672 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:16:47.672 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:16:47.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.E5lF87FzMO 2026-02-19T17:16:47.711 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.E5lF87FzMO 2026-02-19T17:16:47.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:16:47.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-19T17:16:47.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:16:47.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:16:47.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:16:47.713 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:16:47.714 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:16:47.714 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:16:47.714 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:16:47.715 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:16:47.715 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:16:47.786 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:16:47.786 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:16:47.786 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:16:47.786 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:16:47.786 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:16:47.787 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:16:48.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:16:48.004 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:16:48.004 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:16:48.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:16:48.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:16:48.005 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:16:48.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-19T17:16:48.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-19T17:16:48.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-19T17:16:48.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:16:48.090 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:16:48.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T17:16:48.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-19T17:16:48.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T17:16:48.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-19T17:16:48.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:16:48.153 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:16:48.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-19T17:16:48.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-19T17:16:48.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-158913789963' 2026-02-19T17:16:48.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:16:48.237 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-19T17:16:48.237 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:16:48.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:16:48.240 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-19T17:16:48.240 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:16:48.241 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-19T17:16:48.242 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-19T17:16:48.242 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 150323855371 2026-02-19T17:16:48.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:16:48.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-19T17:16:48.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:16:49.465 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:16:49.465 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:16:49.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-19T17:16:49.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:16:49.683 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789963 2026-02-19T17:16:49.683 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:16:49.684 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:16:49.685 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789963 2026-02-19T17:16:49.685 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:16:49.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789963 2026-02-19T17:16:49.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789963' 2026-02-19T17:16:49.687 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 158913789963 2026-02-19T17:16:49.687 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:16:49.908 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-19T17:16:49.909 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:16:49.909 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:49.909 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:50.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:16:50.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:50.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:50.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:50.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:50.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:50.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:50.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:50.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:50.397 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:50.397 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:50.398 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:50.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:50.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T17:16:50.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T17:16:50.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T17:16:50.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:50.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:50.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:50.993 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:50.994 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:50.994 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:50.994 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:51.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:51.281 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:51.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:51.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:51.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T17:16:51.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:51.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T17:16:51.767 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:51.768 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:51.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:51.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:51.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:51.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:51.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:51.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:51.981 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:51.982 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:51.982 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:51.982 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:52.263 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:52.264 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:52.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:52.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:52.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T17:16:52.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:52.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T17:16:52.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:52.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:52.950 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:52.950 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:52.950 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:52.950 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:52.951 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:52.951 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:53.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:53.158 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:53.158 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:53.159 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:53.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:53.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:53.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:53.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:53.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:53.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:53.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:53.447 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:53.447 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:53.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:53.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:53.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T17:16:53.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:53.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T17:16:54.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:54.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:54.530 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:54.530 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:54.530 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:54.530 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:54.530 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:54.530 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:54.743 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:54.744 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:54.744 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:54.744 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:55.031 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:55.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:55.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:55.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T17:16:55.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:55.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T17:16:56.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:16:56.918 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:16:56.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:16:56.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:16:56.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:16:56.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:16:56.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:16:56.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:16:57.130 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:16:57.130 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:16:57.131 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:16:57.131 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:16:57.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:16:57.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:16:57.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:16:57.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:16:57.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:16:57.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:16:57.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:16:57.412 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:16:57.412 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:16:57.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:16:57.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:16:57.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T17:16:57.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:16:57.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T17:17:00.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:17:00.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:17:00.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:17:00.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:17:00.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:17:00.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:17:00.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:17:00.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:17:01.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:17:01.108 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:17:01.109 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:17:01.109 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:17:01.394 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:17:01.395 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:17:01.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:17:01.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:17:01.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T17:17:01.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:17:01.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T17:17:08.072 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:17:08.073 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:17:08.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:17:08.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:17:08.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:17:08.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:17:08.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:17:08.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:17:08.284 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:17:08.285 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:17:08.286 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:17:08.286 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:17:08.569 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:17:08.570 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:17:08.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:17:08.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:17:08.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T17:17:08.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:17:08.855 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T17:17:16.155 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:17:16.155 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:17:16.156 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:17:16.156 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:17:16.157 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:17:16.157 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:17:16.157 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:17:16.157 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:17:16.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:17:16.362 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:17:16.363 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:17:16.363 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:17:16.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:17:16.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:17:16.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:17:16.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:17:16.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:17:16.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:17:16.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:17:16.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:17:16.647 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:17:16.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:17:16.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:17:16.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T17:17:16.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T17:17:17.200 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_fingerprint": "7375f1c7-216b-49ce-a68b-49b705c6a911", 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "version": "20.3.0-5336-g802bf111", 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "commit": "802bf111cd55e57f5842153d7ba2b8b964aa818a", 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "timestamp": "2026-02-19T17:17:17.196415+0000", 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "tag": "", 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "health": { 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "status": "HEALTH_WARN", 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "checks": { 2026-02-19T17:17:17.201 INFO:tasks.workunit.client.0.trial119.stdout: "OSDMAP_FLAGS": { 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "count": 17 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [], 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "OSD_DOWN": { 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:17:17.202 INFO:tasks.workunit.client.0.trial119.stdout: "message": "1 osds down", 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: "message": "osd.1 (root=default,host=trial119) is down" 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: "PG_DEGRADED": { 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:17:17.203 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.204 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "mutes": [] 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_first_committed": 1, 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_last_committed": 1, 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "monmap": { 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:15:34.698054Z", 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:15:34.698054Z", 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release": 20, 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release_name": "tentacle", 2026-02-19T17:17:17.205 INFO:tasks.workunit.client.0.trial119.stdout: "election_strategy": 1, 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "disallowed_leaders": "", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": false, 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "tiebreaker_mon": "", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "removed_ranks": "", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "features": { 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "persistent": [ 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "kraken", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "luminous", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "mimic", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap-prune", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "nautilus", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "octopus", 2026-02-19T17:17:17.206 INFO:tasks.workunit.client.0.trial119.stdout: "pacific", 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "elector-pinging", 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "quincy", 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "reef", 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "squid", 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "tentacle", 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "nvmeof_beacon_diff" 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "optional": [] 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "mons": [ 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.207 INFO:tasks.workunit.client.0.trial119.stdout: "rank": 0, 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "name": "a", 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115", 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 0 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T17:17:17.208 INFO:tasks.workunit.client.0.trial119.stdout: "priority": 0, 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 0, 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "time_added": "2026-02-19T17:15:34:698052+0000", 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "crush_location": [] 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "quorum": [ 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: 0 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap": { 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 40, 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:17:17.209 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:15:34.779032+0000", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:16:17.989664+0000", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "last_up_change": "2026-02-19T17:16:16.904144+0000", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "last_in_change": "2026-02-19T17:16:17.887178+0000", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "flags_num": 5800384, 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "flags_set": [ 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "nodown", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "noin", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "noout", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "pglog_hardlimit", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snapdirs", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "recovery_deletes", 2026-02-19T17:17:17.210 INFO:tasks.workunit.client.0.trial119.stdout: "sortbitwise" 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "crush_version": 9, 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_snapshot": "", 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "pool_max": 1, 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "max_osd": 3, 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "require_min_compat_client": "luminous", 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "min_compat_client": "jewel", 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "require_osd_release": "tentacle", 2026-02-19T17:17:17.211 INFO:tasks.workunit.client.0.trial119.stdout: "allow_crimson": false, 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "pools": [ 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "pool_name": "test", 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "create_time": "2026-02-19T17:15:46.663510+0000", 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "flags": 1, 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "flags_names": "hashpspool", 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "size": 3, 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "min_size": 2, 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "crush_rule": 0, 2026-02-19T17:17:17.212 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_count": 0, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_target": 0, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "is_stretch_pool": false, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "object_hash": 2, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "pg_autoscale_mode": "off", 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num": 1, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num": 1, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num_target": 1, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_target": 1, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_pending": 1, 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "last_pg_merge_meta": { 2026-02-19T17:17:17.213 INFO:tasks.workunit.client.0.trial119.stdout: "source_pgid": "0.0", 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "ready_epoch": 0, 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_started": 0, 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": 0, 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "source_version": "0'0", 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "target_version": "0'0" 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "last_change": "28", 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend": "0", 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "auid": 0, 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "snap_mode": "selfmanaged", 2026-02-19T17:17:17.214 INFO:tasks.workunit.client.0.trial119.stdout: "snap_seq": 0, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "snap_epoch": 0, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "pool_snaps": [], 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps": "[]", 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_bytes": 0, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_objects": 0, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "tiers": [], 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "tier_of": -1, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "read_tier": -1, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "write_tier": -1, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "cache_mode": "none", 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_bytes": 0, 2026-02-19T17:17:17.215 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_objects": 0, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_flush_age": 0, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_evict_age": 0, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profile": "", 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_params": { 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "type": "none" 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_period": 0, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_count": 0, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "use_gmt_hitset": true, 2026-02-19T17:17:17.216 INFO:tasks.workunit.client.0.trial119.stdout: "min_read_recency_for_promote": 0, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "min_write_recency_for_promote": 0, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_search_last_n": 0, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "grade_table": [], 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "stripe_width": 0, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "expected_num_objects": 0, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "fast_read": false, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "nonprimary_shards": "{}", 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "options": {}, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "application_metadata": {}, 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "read_balance": { 2026-02-19T17:17:17.217 INFO:tasks.workunit.client.0.trial119.stdout: "score_type": "Fair distribution", 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "score_acting": 2.9900000095367432, 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "score_stable": 2.9900000095367432, 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_acting": 2, 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_stable": 2, 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity_weighted": 1, 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity": 1, 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity_weighted": 1 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: "osds": [ 2026-02-19T17:17:17.218 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "83f0f2cc-cedb-4624-8347-8371d4cb593d", 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 5, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 35, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 39, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 29, 2026-02-19T17:17:17.219 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6800", 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6801", 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.220 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6802", 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6803", 2026-02-19T17:17:17.221 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6806", 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.222 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6807", 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6804", 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.223 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6805", 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3591656537 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6801/3591656537", 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6803/3591656537", 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3591656537", 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3591656537", 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:17:17.224 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f", 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "up": 0, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 0, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 0, 2026-02-19T17:17:17.225 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 10, 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 22, 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 30, 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.226 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.227 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:17:17.228 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.229 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1156029127 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/1156029127", 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/1156029127", 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1156029127", 2026-02-19T17:17:17.230 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1156029127", 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "exists" 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "95359fb7-0f74-47b1-90ef-5db52f12e7c0", 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 14, 2026-02-19T17:17:17.231 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 37, 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 0, 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 31, 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.232 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.233 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:17:17.234 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.235 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 2833814796 2026-02-19T17:17:17.236 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/2833814796", 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/2833814796", 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2833814796", 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2833814796", 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.237 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "osd_xinfo": [ 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:16:12.657463+0000", 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:15:38.563978+0000", 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:17:17.238 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:16:12.946254+0000", 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.239 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:16:13.232744+0000", 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:15:44.714895+0000", 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap": [], 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_items": [], 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_primaries": [], 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "pg_temp": [], 2026-02-19T17:17:17.240 INFO:tasks.workunit.client.0.trial119.stdout: "primary_temp": [], 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "blocklist": {}, 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "range_blocklist": {}, 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profiles": { 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "default": { 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "m": "2", 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps_queue": [], 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "new_removed_snaps": [], 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "new_purged_snaps": [], 2026-02-19T17:17:17.241 INFO:tasks.workunit.client.0.trial119.stdout: "crush_node_flags": {}, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "device_class_flags": {}, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": { 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_enabled": false, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_bucket_count": 0, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "degraded_stretch_mode": 0, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "recovering_stretch_mode": 0, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_bucket": 0 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "osd_metadata": [ 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:17:17.242 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6802/3591656537,v1:127.0.0.1:6803/3591656537]", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:17:17.243 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:15:35.742248Z", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:17:17.244 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6800/3591656537,v1:127.0.0.1:6801/3591656537]", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3591656537,v1:127.0.0.1:6807/3591656537]", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3591656537,v1:127.0.0.1:6805/3591656537]", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:17:17.245 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/1156029127,v1:127.0.0.1:6813/1156029127]", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:17:17.246 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:17:17.247 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:15:39.412735Z", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/1156029127,v1:127.0.0.1:6811/1156029127]", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1156029127,v1:127.0.0.1:6817/1156029127]", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1156029127,v1:127.0.0.1:6815/1156029127]", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:17:17.248 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/2833814796,v1:127.0.0.1:6813/2833814796]", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:17:17.249 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:17:17.250 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:15:42.304370Z", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/2833814796,v1:127.0.0.1:6811/2833814796]", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2833814796,v1:127.0.0.1:6817/2833814796]", 2026-02-19T17:17:17.251 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2833814796,v1:127.0.0.1:6815/2833814796]", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_clean_epochs": { 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "min_last_epoch_clean": 0, 2026-02-19T17:17:17.252 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": { 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "per_pool": [] 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "osd_epochs": [ 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 35 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 38 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_first_committed": 1, 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_last_committed": 40, 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "crushmap": { 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "devices": [ 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.253 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.0", 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.1", 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.2", 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "types": [ 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 0, 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd" 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.254 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "name": "host" 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 2, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "name": "chassis" 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 3, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "name": "rack" 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 4, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "name": "row" 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 5, 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pdu" 2026-02-19T17:17:17.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 6, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pod" 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 7, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "room" 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 8, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "datacenter" 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 9, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "zone" 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 10, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: "name": "region" 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.256 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "root" 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "buckets": [ 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "id": -1, 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default", 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.257 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "id": -2, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default~ssd", 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119", 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:17:17.258 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:17:17.259 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119~ssd", 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.260 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "rules": [ 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 0, 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "replicated_rule", 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_firstn", 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "tunables": { 2026-02-19T17:17:17.261 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_tries": 0, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_fallback_tries": 0, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "choose_total_tries": 50, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_descend_once": 1, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_vary_r": 1, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_stable": 1, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "msr_descents": 100, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "msr_collision_tries": 100, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "straw_calc_version": 1, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "allowed_bucket_algs": 54, 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stderr:report 2044721290 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "profile": "jewel", 2026-02-19T17:17:17.262 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_tunables": 1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "legacy_tunables": 0, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "minimum_required_version": "jewel", 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables": 1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables2": 1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "has_v2_rules": 0, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables3": 1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "has_v3_rules": 0, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "has_v4_buckets": 1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables5": 1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "has_v5_rules": 0, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "has_msr_rules": 0 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "choose_args": {} 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "fsmap": { 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "btime": "2026-02-19T17:15:34:778787+0000", 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "default_fscid": -1, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "compat": { 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "compat": {}, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "ro_compat": {}, 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "incompat": { 2026-02-19T17:17:17.263 INFO:tasks.workunit.client.0.trial119.stdout: "feature_1": "base v0.20", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_2": "client writeable ranges", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_4": "dir inode in separate object", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_8": "no anchor table", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_9": "file layout v2", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_10": "snaprealm v2", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_11": "minor log segments", 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "feature_flags": { 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "enable_multiple": true, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "ever_enabled_multiple": true 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "standbys": [], 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "filesystems": [] 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_first_committed": 1, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_last_committed": 1, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "auth": { 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 5, 2026-02-19T17:17:17.264 INFO:tasks.workunit.client.0.trial119.stdout: "num_secrets": 3 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_active": 1, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_unknown": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_osd": 3, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "pool_sum": { 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51688, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:17:17.265 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.266 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 17, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 17, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "up": 2, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 2, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 0 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum": { 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83864, 2026-02-19T17:17:17.267 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2080, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 23, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81704, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488936, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036670464, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2129920, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 422978, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 24099, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83665373 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:17:17.268 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum_by_class": { 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "ssd": { 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83864, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2080, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 23, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81704, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488936, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036670464, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2129920, 2026-02-19T17:17:17.269 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 422978, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 24099, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83665373 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: "pool_stats": [ 2026-02-19T17:17:17.270 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51688, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:17:17.271 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 1220608, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 154528, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 17, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 17, 2026-02-19T17:17:17.272 INFO:tasks.workunit.client.0.trial119.stdout: "up": 2, 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 2, 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 3 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd_stats": [ 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 150323855377 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 42949672974 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 158913789968 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_state": [ 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded", 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "num": 1 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "pool_pg_unavailable_map": [ 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": "1", 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "pgs": [] 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.273 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_osd": [ 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 1, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 0, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": [ 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": {} 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "servicemap": { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 4, 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:17:15.245485+0000", 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "services": { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "osd": { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "daemons": { 2026-02-19T17:17:17.274 INFO:tasks.workunit.client.0.trial119.stdout: "summary": "", 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "2": { 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_first_committed": 1, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_last_committed": 51, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "logm_first_committed": 1, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "logm_last_committed": 274, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "paxos": { 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 375, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "last_pn": 0, 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: "accepted_pn": 0 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:17:17.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T17:17:17.276 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery 2026-02-19T17:17:17.276 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-19T17:17:17.276 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:17.425 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:17.425 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:16:17.993385+0000 40'101 40:131 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:26:47.057927+0000 0 0 2026-02-19T17:17:17.426 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:17.426 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:17.426 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:17.434 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:17:17.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-19T17:17:17.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:17:17.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:17:17.436 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:17:17.436 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:17.436 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:17.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:17:17.436 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-19T17:17:17.437 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T17:17:17.491 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:17:17.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-19T17:17:17.497 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-19T17:17:17.498 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:17:17.498 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:17:17.499 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:17:17.499 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:17.499 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:17.499 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:17:17.499 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-19T17:17:17.499 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T17:17:17.553 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:17:17.559 INFO:tasks.workunit.client.0.trial119.stdout:revive divergent 1 2026-02-19T17:17:17.559 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-19T17:17:17.559 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:17.771 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:17.772 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:16:17.993385+0000 40'101 40:131 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:26:47.057927+0000 0 0 2026-02-19T17:17:17.772 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:17.772 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:17.772 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:17.782 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-19T17:17:18.093 INFO:tasks.workunit.client.0.trial119.stderr:noup is set 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:17:18.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:17:18.108 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:17:18.109 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:17:18.109 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:18.109 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:18.109 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:17:18.110 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:17:18.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:17:18.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:17:18.111 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:17:18.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:17:18.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:17:18.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:17:18.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:17:18.132 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:18.122+0000 7f2f9ba89a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:18.133 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:18.126+0000 7f2f9ba89a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:18.134 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:18.126+0000 7f2f9ba89a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:18.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T17:17:18.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-19T17:17:18.526 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:18.518+0000 7f2f9ba89a40 -1 Falling back to public interface 2026-02-19T17:17:19.210 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:19.202+0000 7f2f9ba89a40 -1 osd.1 28 log_to_monitors true 2026-02-19T17:17:23.324 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery divergent 2026-02-19T17:17:23.325 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-19T17:17:23.325 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:23.522 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:23.522 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:16:17.993385+0000 40'101 43:137 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:26:47.057927+0000 0 0 2026-02-19T17:17:23.522 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:23.522 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:23.523 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:23.531 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-19T17:17:23.531 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:17:23.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:17:23.532 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:17:23.532 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:23.532 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:23.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:17:23.533 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-19T17:17:23.533 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T17:17:23.587 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:17:23.592 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-19T17:17:23.913 INFO:tasks.workunit.client.0.trial119.stderr:noup is unset 2026-02-19T17:17:23.924 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-19T17:17:23.924 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:17:23.924 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:17:23.925 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:17:23.925 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:17:23.925 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:23.925 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:23.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:17:23.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:23.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:17:24.139 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 35 up_thru 39 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3591656537,v1:127.0.0.1:6801/3591656537] [v2:127.0.0.1:6802/3591656537,v1:127.0.0.1:6803/3591656537] exists,up 83f0f2cc-cedb-4624-8347-8371d4cb593d 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:24.140 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:24.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:17:24.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:24.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:17:24.344 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/2333238052,v1:127.0.0.1:6819/2333238052] [v2:127.0.0.1:6820/2333238052,v1:127.0.0.1:6821/2333238052] exists,up 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f 2026-02-19T17:17:24.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:17:24.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:17:24.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:17:24.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-19T17:17:24.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:17:24.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:17:24.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:17:24.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:17:24.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:24.347 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:24.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:17:24.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:24.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:17:24.558 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/2833814796,v1:127.0.0.1:6811/2833814796] [v2:127.0.0.1:6812/2833814796,v1:127.0.0.1:6813/2833814796] exists,up 95359fb7-0f74-47b1-90ef-5db52f12e7c0 2026-02-19T17:17:24.558 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:17:24.558 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:17:24.558 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:17:24.558 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:24.759 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:24.759 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:16:17.993385+0000 40'101 43:137 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:26:47.057927+0000 0 0 2026-02-19T17:17:24.759 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:24.760 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:24.760 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:24.771 INFO:tasks.workunit.client.0.trial119.stdout:wait for peering 2026-02-19T17:17:24.772 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-19T17:17:24.772 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:24.973 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:24.974 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:16:17.993385+0000 40'101 43:137 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:26:47.057927+0000 0 0 2026-02-19T17:17:24.974 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:24.974 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:24.974 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:24.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.m8rmDm02Sp 2026-02-19T17:17:25.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.m8rmDm02Sp 2026-02-19T17:17:25.008 INFO:tasks.workunit.client.0.trial119.stdout:killing divergent 1 2026-02-19T17:17:25.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-19T17:17:25.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:25.210 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:25.210 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:16:17.993385+0000 40'101 43:137 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:26:47.057927+0000 0 0 2026-02-19T17:17:25.210 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:25.210 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:25.211 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:25.219 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T17:17:25.219 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:17:25.220 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:17:25.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:17:25.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:17:25.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:17:25.328 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:17:25.328 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.20601.out 2026-02-19T17:17:25.328 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.20601.out 2026-02-19T17:17:25.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T17:17:25.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T17:17:25.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T17:17:25.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T17:17:25.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T17:17:25.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.20601.out 2026-02-19T17:17:25.530 INFO:tasks.workunit.client.0.trial119.stderr:Exporting 1.0 info 1.0( v 46'102 lc 0'0 (28'90,46'102] local-lis/les=45/46 n=101 ec=22/22 lis/c=45/22 les/c/f=46/23/0 sis=45) 2026-02-19T17:17:25.550 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-19T17:17:25.550 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-19T17:17:25.550 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-19T17:17:25.550 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-19T17:17:25.550 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-19T17:17:25.550 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:169157fa:::existing_81:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:17731382:::existing_58:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:28566edb:::existing_78:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:2a101182:::existing_20:head# 2026-02-19T17:17:25.551 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:53588912:::existing_9:head# 2026-02-19T17:17:25.552 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:602f83fe:::foo:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:628918ca:::existing_79:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-19T17:17:25.553 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:750ace21:::existing_19:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:79881152:::existing_63:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:81490677:::existing_76:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-19T17:17:25.554 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:92731e71:::existing_89:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:928205cf:::existing_82:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:93be2267:::existing_24:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:a504a533:::existing_90:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:a691337e:::existing_61:head# 2026-02-19T17:17:25.555 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:b343e277:::existing_88:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:bebec877:::existing_74:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-19T17:17:25.556 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:c156033e:::existing_100:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-19T17:17:25.557 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:e255b710:::existing_55:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:f6809456:::existing_11:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-19T17:17:25.558 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-19T17:17:25.559 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-19T17:17:25.559 INFO:tasks.workunit.client.0.trial119.stderr:Export successful 2026-02-19T17:17:25.559 INFO:tasks.workunit.client.0.trial119.stdout: marking collection for removal 2026-02-19T17:17:25.559 INFO:tasks.workunit.client.0.trial119.stdout:setting '_remove' omap key 2026-02-19T17:17:25.560 INFO:tasks.workunit.client.0.trial119.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-19T17:17:25.560 INFO:tasks.workunit.client.0.trial119.stderr:Remove successful 2026-02-19T17:17:25.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.20601.out 2026-02-19T17:17:25.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T17:17:25.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T17:17:25.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T17:17:25.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T17:17:25.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T17:17:25.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.20601.out 2026-02-19T17:17:25.846 INFO:tasks.workunit.client.0.trial119.stdout:get_pg_num_history pg_num_history pg_num_history(e46 pg_nums {1={22=1}} deleted_pools ) 2026-02-19T17:17:25.846 INFO:tasks.workunit.client.0.trial119.stdout:Importing pgid 1.0 2026-02-19T17:17:25.846 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-19T17:17:25.846 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-19T17:17:25.847 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:169157fa:::existing_81:head# 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:17731382:::existing_58:head# 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-19T17:17:25.848 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:28566edb:::existing_78:head# 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:2a101182:::existing_20:head# 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-19T17:17:25.849 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-19T17:17:25.850 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:53588912:::existing_9:head# 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-19T17:17:25.851 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:602f83fe:::foo:head# 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:628918ca:::existing_79:head# 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.852 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:750ace21:::existing_19:head# 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-19T17:17:25.853 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:79881152:::existing_63:head# 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:81490677:::existing_76:head# 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-19T17:17:25.854 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:92731e71:::existing_89:head# 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:928205cf:::existing_82:head# 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:93be2267:::existing_24:head# 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-19T17:17:25.855 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:a504a533:::existing_90:head# 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:a691337e:::existing_61:head# 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-19T17:17:25.856 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:b343e277:::existing_88:head# 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.857 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:bebec877:::existing_74:head# 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:c156033e:::existing_100:head# 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-19T17:17:25.858 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.859 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.860 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:e255b710:::existing_55:head# 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:f6809456:::existing_11:head# 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-19T17:17:25.861 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.862 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-19T17:17:25.862 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.862 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-19T17:17:25.862 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:17:25.862 INFO:tasks.workunit.client.0.trial119.stdout:write_pg epoch 46 info 1.0( v 46'102 lc 0'0 (28'90,46'102] local-lis/les=45/46 n=101 ec=22/22 lis/c=45/22 les/c/f=46/23/0 sis=45) 2026-02-19T17:17:25.862 INFO:tasks.workunit.client.0.trial119.stdout:Import successful 2026-02-19T17:17:25.945 INFO:tasks.workunit.client.0.trial119.stdout:reviving divergent 1 2026-02-19T17:17:25.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-19T17:17:25.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:26.145 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:26.145 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-19T17:17:24.016175+0000 40'101 46:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:17:26.145 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:26.146 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:26.146 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-19T17:17:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:17:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:17:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:17:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:17:26.158 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:17:26.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:17:26.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:17:26.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:17:26.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:17:26.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:17:26.160 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:17:26.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:17:26.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:17:26.161 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:17:26.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:17:26.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:17:26.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:17:26.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:17:26.184 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:26.174+0000 7f5fbd8fea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:26.186 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:26.178+0000 7f5fbd8fea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:26.187 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:26.178+0000 7f5fbd8fea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:26.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:17:26.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:17:26.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:17:26.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:17:26.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:17:26.368 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:26.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:26.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:17:26.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:26.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:17:26.587 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/2333238052,v1:127.0.0.1:6819/2333238052] [v2:127.0.0.1:6820/2333238052,v1:127.0.0.1:6821/2333238052] exists,up 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f 2026-02-19T17:17:26.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:17:26.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:17:26.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:17:26.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-19T17:17:26.589 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:17:26.589 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:17:26.589 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:17:26.589 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:17:26.589 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:26.589 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:26.590 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:17:26.590 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:26.590 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:17:26.630 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:26.622+0000 7f5fbd8fea40 -1 Falling back to public interface 2026-02-19T17:17:26.796 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/2333238052,v1:127.0.0.1:6819/2333238052] [v2:127.0.0.1:6820/2333238052,v1:127.0.0.1:6821/2333238052] exists,up 28f4efc8-3cf2-4e66-9abe-db5a2e0ab72f 2026-02-19T17:17:26.797 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:17:26.797 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:17:26.797 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:17:26.797 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-19T17:17:27.388 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:27.378+0000 7f5fbd8fea40 -1 osd.1 46 log_to_monitors true 2026-02-19T17:17:46.798 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-19T17:17:46.798 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:17:46.798 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:17:46.799 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:17:46.799 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:46.800 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:46.800 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:17:46.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-19T17:17:46.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.1.asok dump_ops_in_flight 2026-02-19T17:17:46.864 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:17:46.865 INFO:tasks.workunit.client.0.trial119.stdout: "ops": [], 2026-02-19T17:17:46.865 INFO:tasks.workunit.client.0.trial119.stdout: "num_ops": 0 2026-02-19T17:17:46.865 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:17:46.870 INFO:tasks.workunit.client.0.trial119.stdout:allowing recovery 2026-02-19T17:17:46.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-19T17:17:46.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:47.079 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:47.079 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-19T17:17:27.785535+0000 46'102 50:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:07:53.562385+0000 0 0 2026-02-19T17:17:47.079 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:47.079 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:47.080 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:47.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-19T17:17:47.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T17:17:47.163 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:17:47.171 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-19T17:17:47.171 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T17:17:47.257 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:17:47.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-19T17:17:47.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T17:17:47.341 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:17:47.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-19T17:17:47.351 INFO:tasks.workunit.client.0.trial119.stdout:reading divergent objects 2026-02-19T17:17:47.351 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-19T17:17:47.550 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:17:47.550 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-19T17:17:27.785535+0000 46'102 50:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:15:46.684693+0000 0'0 2026-02-19T17:15:46.684693+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:07:53.562385+0000 0 0 2026-02-19T17:17:47.550 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:17:47.551 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:17:47.551 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:17:47.560 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-19T17:17:47.561 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-19T17:17:47.562 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:17:47.562 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T17:17:47.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:17:47.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T17:17:47.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:17:47.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T17:17:47.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:17:47.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T17:17:47.658 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-19T17:17:47.660 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:17:47.660 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-19T17:17:47.679 INFO:tasks.workunit.client.0.trial119.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-19T17:17:47.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:17:47.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-19T17:17:47.707 INFO:tasks.workunit.client.0.trial119.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-19T17:17:47.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-19T17:17:47.710 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-19T17:17:47.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:17:47.715 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-19T17:16:02.083702+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:17:47.715 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-19T17:16:02.083702+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:17:47.715 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: more recent entry found: 40'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-19T17:16:47.703005+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4539.0:1 2026-02-19T17:16:02.074182+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4539.0:1 2026-02-19T17:16:02.074182+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T17:16:02.079240+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T17:16:02.079240+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:17:47.716 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T17:16:02.079240+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'90 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-19T17:16:02.075510+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: keeping 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-19T17:16:02.075510+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:17:47.717 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-19T17:16:02.075510+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'90 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-19T17:16:02.075089+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:17:47.718 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: keeping 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-19T17:16:02.075089+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4541.0:1 2026-02-19T17:16:02.075089+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-19T17:17:47.719 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4542.0:1 2026-02-19T17:16:02.074915+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:17:47.720 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4542.0:1 2026-02-19T17:16:02.074915+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:17:47.720 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:17:47.720 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-19T17:17:47.720 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-19T17:17:47.720 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:17:23.946+0000 7f2f79a07640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-19T17:17:47.720 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-19T17:17:47.720 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:17:47.721 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-19T17:17:47.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:17:47.725 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-19T17:17:47.725 INFO:tasks.workunit.client.0.trial119.stdout:success 2026-02-19T17:17:47.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.20601.out 2026-02-19T17:17:47.727 INFO:tasks.workunit.client.0.trial119.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.20601.out': No such file or directory 2026-02-19T17:17:47.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-19T17:17:47.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T17:17:47.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T17:17:47.982 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' does not exist 2026-02-19T17:17:47.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-19T17:17:47.992 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:17:47.992 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:17:47.993 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:17:47.993 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:17:47.993 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:17:53.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:17:53.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T17:17:53.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:17:53.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:17:53.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:17:53.310 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:17:53.310 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:17:53.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:17:53.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:17:53.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:17:53.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:17:53.317 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:17:53.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:17:53.318 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:17:53.319 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:17:53.319 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:17:53.319 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:17:53.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:17:53.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:17:53.321 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:17:53.321 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:17:53.322 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:17:53.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:17:53.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:17:53.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:17:53.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:17:53.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:17:53.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:17:53.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:17:53.349 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:17:53.350 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:17:53.351 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:17:53.351 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:17:53.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:17:53.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:17:53.353 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:17:53.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:17:53.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:17:53.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:17:53.355 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:17:53.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:17:53.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:17:53.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:17:53.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:17:53.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.359 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:17:53.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:17:53.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:17:53.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T17:17:53.362 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:17:53.362 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.362 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.20601 2026-02-19T17:17:53.363 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:17:53.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T17:17:53.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:17:53.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T17:17:53.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-19T17:17:53.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-19T17:17:53.365 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-19T17:17:53.365 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-19T17:17:53.365 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-19T17:17:53.366 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.gJstai4wSg 2026-02-19T17:17:53.366 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.gJstai4wSg bs=512 count=1 2026-02-19T17:17:53.367 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:17:53.367 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:17:53.368 INFO:tasks.workunit.client.0.trial119.stderr:512 bytes copied, 0.000196859 s, 2.6 MB/s 2026-02-19T17:17:53.368 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.gJstai4wSg 2026-02-19T17:17:53.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.gJstai4wSg 2026-02-19T17:17:53.368 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-19T17:17:53.369 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-19T17:17:53.369 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-19T17:17:53.369 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.iucwQTrhFq 2026-02-19T17:17:53.370 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.iucwQTrhFq bs=1000 count=1 2026-02-19T17:17:53.371 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:17:53.371 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:17:53.371 INFO:tasks.workunit.client.0.trial119.stderr:1000 bytes (1.0 kB) copied, 8.7965e-05 s, 11.4 MB/s 2026-02-19T17:17:53.371 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.iucwQTrhFq 2026-02-19T17:17:53.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.iucwQTrhFq 2026-02-19T17:17:53.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-19T17:17:53.372 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-19T17:17:53.373 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-19T17:17:53.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-19T17:17:53.374 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:17:53.374 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:17:53.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-19T17:17:53.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T17:17:53.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:17:53.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:17:53.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:17:53.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T17:17:53.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T17:17:53.406 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:17:53.406 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:17:53.406 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:17:53.406 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:17:53.406 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.407 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.407 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:53.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:17:53.441 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:17:53.442 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:17:53.442 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:17:53.442 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:17:53.443 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:17:53.444 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:17:53.444 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:17:53.444 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:17:53.444 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:17:53.444 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:17:53.444 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.445 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.445 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:17:53.445 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:17:53.445 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get fsid 2026-02-19T17:17:53.500 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:17:53.500 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:17:53.500 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:17:53.500 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:17:53.500 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:17:53.500 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:17:53.501 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:17:53.501 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:17:53.502 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:17:53.502 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.502 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.502 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:17:53.502 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:17:53.502 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get mon_host 2026-02-19T17:17:53.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-19T17:17:53.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T17:17:53.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:17:53.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:17:53.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:17:53.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T17:17:53.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:17:53.670 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:17:53.670 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:17:53.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:17:53.671 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:17:53.671 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.671 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:53.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:17:53.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:17:53.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:17:53.697 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:17:53.698 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:17:53.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:17:53.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:17:53.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:17:53.699 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:17:53.699 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13 2026-02-19T17:17:53.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13' 2026-02-19T17:17:53.700 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13 2026-02-19T17:17:53.700 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:17:53.711 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDBRZdpxQ00KhAAS2abMLMyEapV48V/dIQG4Q== 2026-02-19T17:17:53.711 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDBRZdpxQ00KhAAS2abMLMyEapV48V/dIQG4Q=="}' 2026-02-19T17:17:53.711 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13 -i td/divergent-priors/0/new.json 2026-02-19T17:17:53.823 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:53.831 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T17:17:53.832 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDBRZdpxQ00KhAAS2abMLMyEapV48V/dIQG4Q== --osd-uuid 1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13 2026-02-19T17:17:53.852 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:53.847+0000 7f7522109a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:53.854 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:53.847+0000 7f7522109a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:53.854 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:53.847+0000 7f7522109a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:53.855 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:53.847+0000 7f7522109a40 -1 bdev(0x55c2aa4e2400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:17:53.855 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:53.847+0000 7f7522109a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T17:17:54.602 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T17:17:54.603 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:17:54.603 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:17:54.604 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:17:54.604 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:17:54.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:17:54.722 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:17:54.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:17:54.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:17:54.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:17:54.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:17:54.741 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:54.735+0000 7f80f40bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:54.742 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:54.735+0000 7f80f40bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:54.743 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:54.735+0000 7f80f40bea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:54.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:17:54.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:17:54.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:17:54.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:17:54.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:17:54.836 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:54.837 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:54.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:17:54.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:54.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:17:54.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:17:55.173 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:55.167+0000 7f80f40bea40 -1 Falling back to public interface 2026-02-19T17:17:55.893 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:55.887+0000 7f80f40bea40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:17:55.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:17:55.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:55.953 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:17:55.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:17:55.954 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:55.954 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:17:56.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:17:57.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:17:57.160 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:17:57.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:57.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:17:57.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:57.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:17:57.369 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/426668483,v1:127.0.0.1:6801/426668483] [v2:127.0.0.1:6802/426668483,v1:127.0.0.1:6803/426668483] exists,up 1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13 2026-02-19T17:17:57.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:17:57.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:17:57.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:17:57.371 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:17:57.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:17:57.373 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:17:57.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df 2026-02-19T17:17:57.374 INFO:tasks.workunit.client.0.trial119.stdout:add osd1 e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df 2026-02-19T17:17:57.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df' 2026-02-19T17:17:57.375 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:17:57.389 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDFRZdpeYsNFxAAI8BGa/IXuhltmASjx0CcQA== 2026-02-19T17:17:57.389 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDFRZdpeYsNFxAAI8BGa/IXuhltmASjx0CcQA=="}' 2026-02-19T17:17:57.389 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df -i td/divergent-priors/1/new.json 2026-02-19T17:17:57.608 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:17:57.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T17:17:57.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDFRZdpeYsNFxAAI8BGa/IXuhltmASjx0CcQA== --osd-uuid e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df 2026-02-19T17:17:57.637 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:57.631+0000 7f5fd7f95a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:57.638 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:57.631+0000 7f5fd7f95a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:57.639 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:57.635+0000 7f5fd7f95a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:57.639 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:57.635+0000 7f5fd7f95a40 -1 bdev(0x555e139ec400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T17:17:57.640 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:57.635+0000 7f5fd7f95a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T17:17:58.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T17:17:58.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:17:58.255 INFO:tasks.workunit.client.0.trial119.stdout:adding osd1 key to auth repository 2026-02-19T17:17:58.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T17:17:58.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:17:58.536 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:17:58.537 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T17:17:58.538 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:17:58.538 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:17:58.538 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:17:58.538 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:17:58.566 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:58.559+0000 7fccedafda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:58.568 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:58.563+0000 7fccedafda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:58.569 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:58.563+0000 7fccedafda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:17:58.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T17:17:58.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:17:58.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:17:58.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:17:58.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:17:58.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:58.750 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:17:58.751 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:17:58.751 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:58.751 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:17:58.945 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:58.939+0000 7fccedafda40 -1 Falling back to public interface 2026-02-19T17:17:58.963 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:17:59.554 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:17:59.547+0000 7fccedafda40 -1 osd.1 0 log_to_monitors true 2026-02-19T17:17:59.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:17:59.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:17:59.964 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:17:59.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:17:59.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:17:59.964 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:18:00.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:18:01.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:18:01.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:18:01.183 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:18:01.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:18:01.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:18:01.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:18:01.397 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3766801748,v1:127.0.0.1:6811/3766801748] [v2:127.0.0.1:6812/3766801748,v1:127.0.0.1:6813/3766801748] exists,up e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:18:01.398 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:18:01.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:18:01.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:18:01.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=10849c2f-a0ab-4827-adee-2ec00a332f47 2026-02-19T17:18:01.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 10849c2f-a0ab-4827-adee-2ec00a332f47' 2026-02-19T17:18:01.402 INFO:tasks.workunit.client.0.trial119.stdout:add osd2 10849c2f-a0ab-4827-adee-2ec00a332f47 2026-02-19T17:18:01.402 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:18:01.416 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDJRZdp3nufGBAAEQixNgfUfcNtsx5Vku4PLA== 2026-02-19T17:18:01.416 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDJRZdp3nufGBAAEQixNgfUfcNtsx5Vku4PLA=="}' 2026-02-19T17:18:01.416 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 10849c2f-a0ab-4827-adee-2ec00a332f47 -i td/divergent-priors/2/new.json 2026-02-19T17:18:01.629 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:18:01.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T17:18:01.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDJRZdp3nufGBAAEQixNgfUfcNtsx5Vku4PLA== --osd-uuid 10849c2f-a0ab-4827-adee-2ec00a332f47 2026-02-19T17:18:01.659 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:01.650+0000 7f84dd95fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:01.660 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:01.654+0000 7f84dd95fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:01.661 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:01.654+0000 7f84dd95fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:01.662 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:01.654+0000 7f84dd95fa40 -1 bdev(0x557463a04400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T17:18:01.662 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:01.654+0000 7f84dd95fa40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T17:18:02.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T17:18:02.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:18:02.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T17:18:02.316 INFO:tasks.workunit.client.0.trial119.stdout:adding osd2 key to auth repository 2026-02-19T17:18:02.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:18:02.605 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:18:02.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T17:18:02.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:18:02.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:18:02.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:18:02.606 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:18:02.635 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:02.626+0000 7fec39cb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:02.637 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:02.630+0000 7fec39cb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:02.638 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:02.630+0000 7fec39cb3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:02.821 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T17:18:02.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:18:02.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:18:02.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:18:02.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:18:02.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:18:02.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:18:02.822 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:18:02.823 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:18:02.823 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:18:03.005 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:02.998+0000 7fec39cb3a40 -1 Falling back to public interface 2026-02-19T17:18:03.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:18:03.614 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:03.606+0000 7fec39cb3a40 -1 osd.2 0 log_to_monitors true 2026-02-19T17:18:04.041 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:18:04.041 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:18:04.041 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:18:04.042 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:18:04.042 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:18:04.043 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:18:04.251 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2729026841,v1:127.0.0.1:6819/2729026841] [v2:127.0.0.1:6820/2729026841,v1:127.0.0.1:6821/2729026841] exists,up 10849c2f-a0ab-4827-adee-2ec00a332f47 2026-02-19T17:18:04.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:18:04.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:18:04.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:18:04.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-19T17:18:04.522 INFO:tasks.workunit.client.0.trial119.stderr:noout is set 2026-02-19T17:18:04.536 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-19T17:18:04.827 INFO:tasks.workunit.client.0.trial119.stderr:noin is set 2026-02-19T17:18:04.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-19T17:18:05.131 INFO:tasks.workunit.client.0.trial119.stderr:nodown is set 2026-02-19T17:18:05.143 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-19T17:18:05.143 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-19T17:18:05.386 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' already exists 2026-02-19T17:18:05.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:18:06.396 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-19T17:18:06.705 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 size to 3 2026-02-19T17:18:06.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-19T17:18:07.012 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 min_size to 2 2026-02-19T17:18:07.023 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-19T17:18:07.316 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 pg_autoscale_mode to on 2026-02-19T17:18:07.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-19T17:18:07.330 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-19T17:18:07.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771521487 2026-02-19T17:18:07.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-19T17:18:07.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-19T17:18:07.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-19T17:18:07.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:18:07.332 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:18:07.546 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:18:07.546 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:18:07.546 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:18:07.546 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:18:07.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:07.547 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:18:07.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-19T17:18:07.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-19T17:18:07.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-19T17:18:07.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:07.628 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:18:07.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-19T17:18:07.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-19T17:18:07.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-19T17:18:07.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:07.710 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:18:07.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-19T17:18:07.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-19T17:18:07.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542147' 2026-02-19T17:18:07.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:07.792 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-19T17:18:07.793 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:07.793 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:18:07.794 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-19T17:18:07.794 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:07.796 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-19T17:18:07.796 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-19T17:18:07.796 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836485 2026-02-19T17:18:07.796 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:18:08.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-19T17:18:08.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:08.012 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-19T17:18:08.012 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:08.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:18:08.013 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-19T17:18:08.013 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:08.014 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-19T17:18:08.015 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 38654705668 2026-02-19T17:18:08.015 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-19T17:18:08.015 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:18:08.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-19T17:18:08.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:08.239 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-19T17:18:08.240 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:08.241 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:18:08.241 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-19T17:18:08.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:08.243 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-19T17:18:08.243 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542147 2026-02-19T17:18:08.243 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-19T17:18:08.243 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:18:08.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-19T17:18:08.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-19T17:18:08.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:18:08.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:18:08.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:18:08.478 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:18:08.479 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:18:08.479 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:18:08.479 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:18:08.479 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:18:08.479 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:18:08.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:18:08.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:18:08.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:18:08.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:18:08.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:18:08.585 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:18:08.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:18:08.805 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:18:08.805 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:18:08.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:18:08.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:08.805 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:18:08.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-19T17:18:08.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-19T17:18:08.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-19T17:18:08.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:08.891 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:18:08.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-19T17:18:08.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-19T17:18:08.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-19T17:18:08.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:08.972 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:18:09.052 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-19T17:18:09.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-19T17:18:09.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-60129542149' 2026-02-19T17:18:09.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:09.054 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-19T17:18:09.054 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:09.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:18:09.055 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-19T17:18:09.055 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:09.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-19T17:18:09.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-19T17:18:09.057 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836487 2026-02-19T17:18:09.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:18:09.269 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-19T17:18:09.269 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:18:10.270 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:18:10.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:18:10.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-19T17:18:10.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:10.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-19T17:18:10.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:10.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:18:10.489 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-19T17:18:10.490 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:10.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-19T17:18:10.491 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 38654705670 2026-02-19T17:18:10.492 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-19T17:18:10.492 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:18:10.714 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-19T17:18:10.715 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:10.715 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-19T17:18:10.715 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:10.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:18:10.717 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-19T17:18:10.717 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:10.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-19T17:18:10.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-19T17:18:10.719 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542149 2026-02-19T17:18:10.719 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:18:10.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542149 2026-02-19T17:18:10.941 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:18:10.941 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:10.942 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:11.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:18:11.221 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:11.221 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:11.221 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:11.221 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:11.221 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:11.222 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:11.222 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:11.435 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:18:11.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:11.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:11.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:11.721 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:18:11.721 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:18:11.721 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:18:11.722 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-19T17:18:11.722 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-19T17:18:11.926 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:18:11.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-19T17:18:11.939 INFO:tasks.workunit.client.0.trial119.stdout:primary and soon to be divergent is 1 2026-02-19T17:18:11.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-19T17:18:11.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:18:12.144 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:18:12.144 INFO:tasks.workunit.client.0.trial119.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T17:18:06.618532+0000 0'0 28:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:49:54.623469+0000 0 0 2026-02-19T17:18:12.145 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:18:12.145 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:18:12.145 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:18:12.154 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-19T17:18:12.154 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771521492 2026-02-19T17:18:12.155 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771521492 - 1771521487 2026-02-19T17:18:12.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=5 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 5 -gt 300 ']' 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-19T17:18:12.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-19T17:18:12.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-19T17:18:12.159 INFO:tasks.workunit.client.0.trial119.stdout:writing initial objects 2026-02-19T17:18:12.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-19T17:18:12.160 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-19T17:18:12.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.181 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.181 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.286 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.286 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.400 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.400 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.457 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.457 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.506 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.506 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.533 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.534 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.561 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.562 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.589 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.589 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.702 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.702 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.758 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.758 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.809 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.809 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.863 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.863 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.889 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.889 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:12.973 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:12.974 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.052 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.052 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.082 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.109 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.109 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.193 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.193 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.222 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.222 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.333 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.383 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.383 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.438 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.495 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.495 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.550 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.550 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.578 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.578 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.606 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.606 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.689 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.689 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.717 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.717 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.831 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.832 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.885 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.885 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.963 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.963 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:13.983 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:13.983 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.038 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.038 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.063 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.106 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.187 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.187 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.216 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.216 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.273 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.274 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.385 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.413 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.414 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.442 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.442 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.470 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.470 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.519 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.519 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.601 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.601 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.657 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.657 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.736 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.736 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.757 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.757 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.785 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.785 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-19T17:18:14.842 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.gJstai4wSg 2026-02-19T17:18:14.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:18:14.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-19T17:18:14.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:18:14.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:18:14.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:18:14.871 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:18:14.872 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:18:14.872 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:18:14.872 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:18:14.873 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:18:14.873 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:18:14.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:18:14.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:18:14.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:18:14.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:18:14.944 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:18:14.944 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:18:15.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:18:15.158 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:18:15.159 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:18:15.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:18:15.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:15.159 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:18:15.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-19T17:18:15.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-19T17:18:15.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-19T17:18:15.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:15.244 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:18:15.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-19T17:18:15.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-19T17:18:15.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-19T17:18:15.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:15.325 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:18:15.404 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-19T17:18:15.405 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-19T17:18:15.405 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-60129542153' 2026-02-19T17:18:15.405 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:15.405 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-19T17:18:15.405 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:15.406 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:18:15.406 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-19T17:18:15.406 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:15.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-19T17:18:15.408 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836490 2026-02-19T17:18:15.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-19T17:18:15.409 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:18:15.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-19T17:18:15.616 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:18:16.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:18:16.618 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:18:16.835 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-19T17:18:16.835 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:16.836 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705673 2026-02-19T17:18:16.836 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:16.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:18:16.838 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-19T17:18:16.838 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:16.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705673 2026-02-19T17:18:16.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-19T17:18:16.840 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 38654705673 2026-02-19T17:18:16.840 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:18:17.052 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705673 2026-02-19T17:18:17.052 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:17.052 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-19T17:18:17.052 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:17.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:18:17.054 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-19T17:18:17.054 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:17.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-19T17:18:17.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-19T17:18:17.057 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542153 2026-02-19T17:18:17.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:18:17.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-19T17:18:17.265 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:18:17.265 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:17.265 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:17.545 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:18:17.545 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:17.546 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:17.546 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:17.546 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:17.546 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:17.546 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:17.546 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:17.755 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:18:17.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:17.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:17.756 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:18.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:18:18.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:18:18.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:18:18.036 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-19T17:18:18.036 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T17:18:18.036 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T17:18:18.036 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T17:18:18.036 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T17:18:18.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-19T17:18:18.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-19T17:18:18.250 INFO:tasks.workunit.client.0.trial119.stdout:blackholing osds 0 2 2026-02-19T17:18:18.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:18:18.451 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:18:18.451 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T17:18:06.618532+0000 28'100 28:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:49:54.623469+0000 0 0 2026-02-19T17:18:18.451 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:18:18.451 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:18:18.451 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:18:18.460 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:18.460 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-19T17:18:18.461 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:18:18.461 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:18:18.462 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:18:18.462 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:18:18.462 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:18:18.462 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:18:18.462 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-19T17:18:18.462 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T17:18:18.515 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:18:18.515 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:18:18.515 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:18:18.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:18.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-19T17:18:18.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:18:18.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:18:18.522 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:18:18.522 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:18:18.523 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:18:18.523 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:18:18.523 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-19T17:18:18.523 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T17:18:18.575 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:18:18.575 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:18:18.576 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:18:18.581 INFO:tasks.workunit.client.0.trial119.stdout:create new divergent objects 2026-02-19T17:18:18.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-19T17:18:18.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-19T17:18:18.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:18:18.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:18:18.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-19T17:18:18.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-19T17:18:18.583 INFO:tasks.workunit.client.0.trial119.stdout:writing divergent objects 2026-02-19T17:18:18.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-19T17:18:18.584 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-19T17:18:18.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T17:18:18.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-19T17:18:18.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.iucwQTrhFq 2026-02-19T17:18:18.585 INFO:tasks.workunit.client.0.trial119.stdout:remove divergent objects 2026-02-19T17:18:18.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-19T17:18:18.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.iucwQTrhFq 2026-02-19T17:18:18.586 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-19T17:18:18.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T17:18:18.587 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-19T17:18:18.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-19T17:18:18.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-19T17:18:18.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-19T17:18:18.589 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-19T17:18:18.590 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-19T17:18:18.590 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-19T17:18:18.590 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-19T17:18:28.592 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-19T17:18:28.647 INFO:tasks.workunit.client.0.trial119.stderr:rados: no process found 2026-02-19T17:18:28.647 INFO:tasks.workunit.client.0.trial119.stdout:killing all the osds 2026-02-19T17:18:28.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-19T17:18:28.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:18:28.865 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:18:28.865 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-19T17:18:06.618532+0000 28'106 28:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:49:54.623469+0000 0 0 2026-02-19T17:18:28.865 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:18:28.865 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:18:28.866 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:18:28.873 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-19T17:18:28.874 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:18:28.875 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:18:28.875 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:18:28.875 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:18:28.875 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:18:28.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:18:28.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-19T17:18:28.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-19T17:18:29.242 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:18:29.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-19T17:18:29.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-19T17:18:29.515 INFO:tasks.workunit.client.0.trial119.stderr:osd.1 is already down. 2026-02-19T17:18:29.524 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-19T17:18:29.524 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-19T17:18:29.796 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already down. 2026-02-19T17:18:29.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:29.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-19T17:18:30.104 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already out. 2026-02-19T17:18:30.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:30.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-19T17:18:30.389 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already out. 2026-02-19T17:18:30.399 INFO:tasks.workunit.client.0.trial119.stdout:bringing up non_divergent 0 2 2026-02-19T17:18:30.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-19T17:18:30.400 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:18:30.612 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:18:30.612 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-19T17:18:06.618532+0000 28'106 28:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:49:54.623469+0000 0 0 2026-02-19T17:18:30.612 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:18:30.613 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:18:30.613 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:18:30.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:18:30.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:18:30.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:18:30.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:18:30.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:18:30.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:18:30.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:18:30.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:18:30.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:18:30.629 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:18:30.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:18:30.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:18:30.630 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T17:18:30.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:18:30.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:18:30.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:18:30.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:18:30.649 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:30.643+0000 7f945c63ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:30.650 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:30.643+0000 7f945c63ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:30.651 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:30.647+0000 7f945c63ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:30.844 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:18:30.844 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:18:30.844 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:18:30.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:18:30.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:18:30.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:18:30.845 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:18:30.846 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:18:30.846 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:18:30.846 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:18:31.005 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:30.999+0000 7f945c63ba40 -1 Falling back to public interface 2026-02-19T17:18:31.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:18:31.720 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:31.715+0000 7f945c63ba40 -1 osd.0 28 log_to_monitors true 2026-02-19T17:18:32.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:18:32.062 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:18:32.063 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:18:32.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:18:32.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:18:32.064 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:18:32.279 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3366675155,v1:127.0.0.1:6801/3366675155] [v2:127.0.0.1:6802/3366675155,v1:127.0.0.1:6803/3366675155] exists,up 1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:18:32.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:18:32.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:18:32.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:18:32.283 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:18:32.283 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:18:32.283 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:18:32.283 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T17:18:32.284 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:18:32.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:18:32.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:18:32.285 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:18:32.303 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:32.299+0000 7f4f0f530a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:32.305 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:32.299+0000 7f4f0f530a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:32.306 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:32.299+0000 7f4f0f530a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:18:32.495 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:18:32.495 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:18:32.495 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:18:32.495 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:18:32.495 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:18:32.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:18:32.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:18:32.496 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:18:32.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:18:32.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:18:32.685 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:32.679+0000 7f4f0f530a40 -1 Falling back to public interface 2026-02-19T17:18:32.711 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:18:33.301 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:18:33.295+0000 7f4f0f530a40 -1 osd.2 28 log_to_monitors true 2026-02-19T17:18:33.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:18:33.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:18:33.712 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:18:33.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:18:33.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:18:33.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:18:33.929 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/1971069295,v1:127.0.0.1:6811/1971069295] [v2:127.0.0.1:6812/1971069295,v1:127.0.0.1:6813/1971069295] exists,up 10849c2f-a0ab-4827-adee-2ec00a332f47 2026-02-19T17:18:33.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:18:33.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:18:33.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:18:33.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:33.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-19T17:18:34.175 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already in. 2026-02-19T17:18:34.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:18:34.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-19T17:18:34.476 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already in. 2026-02-19T17:18:34.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:18:34.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-19T17:18:34.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:18:34.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:18:34.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:18:34.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:18:34.488 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:18:34.488 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:18:34.489 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:18:34.489 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:18:34.489 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:18:34.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:18:34.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:18:34.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:18:34.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:18:34.556 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:18:34.556 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:18:34.766 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:18:34.766 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:18:34.766 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:18:34.766 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:18:34.766 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:34.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:18:34.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-19T17:18:34.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-19T17:18:34.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-19T17:18:34.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:34.849 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:18:34.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T17:18:34.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-19T17:18:34.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T17:18:34.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-19T17:18:34.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:18:34.914 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:18:34.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-19T17:18:34.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-19T17:18:34.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-163208757251' 2026-02-19T17:18:34.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:34.995 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-19T17:18:34.995 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:34.995 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:18:34.996 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-19T17:18:34.996 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-19T17:18:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-19T17:18:34.998 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 150323855363 2026-02-19T17:18:34.998 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:18:35.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-19T17:18:35.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:18:36.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:18:36.214 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:18:36.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-19T17:18:36.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:18:36.434 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757251 2026-02-19T17:18:36.434 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:18:36.435 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:18:36.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-19T17:18:36.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:18:36.437 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-19T17:18:36.438 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 163208757251 2026-02-19T17:18:36.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-19T17:18:36.439 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:18:36.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-19T17:18:36.663 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:18:36.663 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:36.663 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:36.944 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:18:36.944 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:36.945 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:36.945 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:36.945 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:36.945 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:36.945 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:36.945 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:37.156 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:37.156 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:37.157 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:37.157 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:37.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:37.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T17:18:37.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T17:18:37.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T17:18:37.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:37.433 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T17:18:37.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:18:37.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:37.535 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:37.535 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:37.535 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:37.536 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:37.536 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:37.536 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:37.743 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:37.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:37.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:37.743 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:18:38.027 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:18:38.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:18:38.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:18:38.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:18:38.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T17:18:38.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:38.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T17:18:38.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:18:38.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:38.514 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:38.514 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:38.515 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:38.515 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:38.515 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:38.515 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:38.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:38.726 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:38.726 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:38.726 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:39.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:18:39.008 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:18:39.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:18:39.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:18:39.291 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T17:18:39.291 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:39.291 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T17:18:39.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:18:39.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:39.692 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:39.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:39.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:39.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:39.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:39.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:39.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:39.903 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:39.903 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:39.903 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:40.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:40.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:18:40.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:18:40.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:18:40.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:18:40.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:18:40.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:18:40.180 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:18:40.180 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:18:40.452 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:18:40.452 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:18:40.452 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T17:18:40.452 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:40.452 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T17:18:41.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:18:41.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:41.254 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:41.255 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:41.255 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:41.255 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:41.255 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:41.255 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:41.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:41.463 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:41.464 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:41.464 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:18:41.742 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:18:42.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:18:42.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:18:42.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T17:18:42.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:42.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T17:18:43.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:18:43.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:43.626 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:43.626 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:43.627 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:43.627 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:43.627 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:43.627 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:43.837 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:43.837 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:43.837 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:43.838 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:44.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:44.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:18:44.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:18:44.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:18:44.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:18:44.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:18:44.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:18:44.121 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:18:44.121 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:18:44.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:18:44.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:18:44.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T17:18:44.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:44.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T17:18:47.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:18:47.611 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:47.612 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:47.612 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:47.612 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:47.612 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:47.612 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:47.612 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:47.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:47.826 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:47.827 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:47.827 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:48.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:48.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:18:48.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:18:48.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:18:48.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:18:48.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:18:48.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:18:48.111 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:18:48.111 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:18:48.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:18:48.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:18:48.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T17:18:48.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:48.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T17:18:54.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:18:54.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:18:54.803 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:18:54.803 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:18:54.803 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:18:54.803 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:18:54.804 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:18:54.804 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:18:55.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:18:55.019 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:18:55.019 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:18:55.019 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:18:55.301 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:18:55.301 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:18:55.301 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:18:55.301 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:18:55.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:18:55.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:18:55.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:18:55.302 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:18:55.302 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:18:55.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:18:55.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:18:55.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T17:18:55.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:18:55.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T17:19:02.889 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:02.889 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:02.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:02.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:02.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:02.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:02.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:02.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:03.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:03.109 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:03.109 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:03.109 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:03.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:03.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:03.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:03.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:03.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:03.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:03.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:03.396 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:03.396 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:03.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:03.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:03.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T17:19:03.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_fingerprint": "11b5c8d2-fa1a-45c6-b5c4-ce0516106704", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "version": "20.3.0-5336-g802bf111", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "commit": "802bf111cd55e57f5842153d7ba2b8b964aa818a", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "timestamp": "2026-02-19T17:19:03.948834+0000", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "tag": "", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "health": { 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "status": "HEALTH_WARN", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "checks": { 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "OSDMAP_FLAGS": { 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: "count": 17 2026-02-19T17:19:03.951 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [], 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "OSD_DOWN": { 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "message": "1 osds down", 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "message": "osd.1 (root=default,host=trial119) is down" 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "PG_DEGRADED": { 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "count": 32 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.952 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.953 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.954 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: "mutes": [] 2026-02-19T17:19:03.955 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_first_committed": 1, 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_last_committed": 1, 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "monmap": { 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:17:53.394907Z", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:17:53.394907Z", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release": 20, 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release_name": "tentacle", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "election_strategy": 1, 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "disallowed_leaders": "", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": false, 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "tiebreaker_mon": "", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "removed_ranks": "", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "features": { 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "persistent": [ 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "kraken", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "luminous", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "mimic", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap-prune", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "nautilus", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "octopus", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "pacific", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "elector-pinging", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "quincy", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "reef", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "squid", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "tentacle", 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "nvmeof_beacon_diff" 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: "optional": [] 2026-02-19T17:19:03.956 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "mons": [ 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "rank": 0, 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "name": "a", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 0 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "priority": 0, 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 0, 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "time_added": "2026-02-19T17:17:53:394905+0000", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "crush_location": [] 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "quorum": [ 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: 0 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap": { 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 45, 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:17:53.479033+0000", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:18:58.045060+0000", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "last_up_change": "2026-02-19T17:18:33.454727+0000", 2026-02-19T17:19:03.957 INFO:tasks.workunit.client.0.trial119.stdout: "last_in_change": "2026-02-19T17:18:34.420244+0000", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "flags_num": 5800384, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "flags_set": [ 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "nodown", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "noin", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "noout", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "pglog_hardlimit", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snapdirs", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "recovery_deletes", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "sortbitwise" 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "crush_version": 9, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_snapshot": "", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "pool_max": 1, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "max_osd": 3, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "require_min_compat_client": "luminous", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "min_compat_client": "jewel", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "require_osd_release": "tentacle", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "allow_crimson": false, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "pools": [ 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "pool_name": "test", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "create_time": "2026-02-19T17:18:05.307992+0000", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "flags": 1, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "flags_names": "hashpspool", 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:19:03.958 INFO:tasks.workunit.client.0.trial119.stdout: "size": 3, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "min_size": 2, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "crush_rule": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_count": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_target": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "is_stretch_pool": false, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "object_hash": 2, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "pg_autoscale_mode": "on", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num": 32, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num": 1, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num_target": 32, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_target": 32, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_pending": 32, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "last_pg_merge_meta": { 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "source_pgid": "0.0", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "ready_epoch": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_started": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "source_version": "0'0", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "target_version": "0'0" 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "last_change": "44", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend": "0", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_preluminous": "44", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "auid": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "snap_mode": "selfmanaged", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "snap_seq": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "snap_epoch": 0, 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "pool_snaps": [], 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps": "[]", 2026-02-19T17:19:03.959 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_bytes": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_objects": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "tiers": [], 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "tier_of": -1, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "read_tier": -1, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "write_tier": -1, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "cache_mode": "none", 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_bytes": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_objects": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_flush_age": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_evict_age": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profile": "", 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_params": { 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "type": "none" 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_period": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_count": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "use_gmt_hitset": true, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "min_read_recency_for_promote": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "min_write_recency_for_promote": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_search_last_n": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "grade_table": [], 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "stripe_width": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "expected_num_objects": 0, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "fast_read": false, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "nonprimary_shards": "{}", 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "options": {}, 2026-02-19T17:19:03.960 INFO:tasks.workunit.client.0.trial119.stdout: "application_metadata": {}, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "read_balance": { 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "score_type": "Fair distribution", 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "score_acting": 2.9900000095367432, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "score_stable": 2.9900000095367432, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_acting": 2, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_stable": 2, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity_weighted": 1, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity": 1, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity_weighted": 1 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "osds": [ 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13", 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 5, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 35, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 44, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 29, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.961 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6800", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6801", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6802", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6803", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6806", 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.962 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6807", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6804", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6805", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6801/3366675155", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6803/3366675155", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3366675155", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3366675155", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:03.963 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df", 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "up": 0, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 0, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 0, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 9, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 21, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 30, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.964 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:03.965 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/3766801748", 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/3766801748", 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3766801748", 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3766801748", 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "exists" 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "10849c2f-a0ab-4827-adee-2ec00a332f47", 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 14, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 38, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 0, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 31, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.966 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.967 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/1971069295", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/1971069295", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1971069295", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1971069295", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "osd_xinfo": [ 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:18:29.185557+0000", 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:19:03.968 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:17:56.910412+0000", 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:18:29.458726+0000", 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:18:00.551725+0000", 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:18:29.740088+0000", 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:18:04.626157+0000", 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap": [], 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_items": [], 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_primaries": [], 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "pg_temp": [], 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "primary_temp": [], 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "blocklist": {}, 2026-02-19T17:19:03.969 INFO:tasks.workunit.client.0.trial119.stdout: "range_blocklist": {}, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profiles": { 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "default": { 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "m": "2", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps_queue": [], 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "new_removed_snaps": [], 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "new_purged_snaps": [], 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "crush_node_flags": {}, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "device_class_flags": {}, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": { 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_enabled": false, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_bucket_count": 0, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "degraded_stretch_mode": 0, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "recovering_stretch_mode": 0, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_bucket": 0 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "osd_metadata": [ 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6802/3366675155,v1:127.0.0.1:6803/3366675155]", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:19:03.970 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:17:54.468598Z", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:19:03.971 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6800/3366675155,v1:127.0.0.1:6801/3366675155]", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3366675155,v1:127.0.0.1:6807/3366675155]", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3366675155,v1:127.0.0.1:6805/3366675155]", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/3766801748,v1:127.0.0.1:6813/3766801748]", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:19:03.972 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:17:58.148738Z", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/3766801748,v1:127.0.0.1:6811/3766801748]", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3766801748,v1:127.0.0.1:6817/3766801748]", 2026-02-19T17:19:03.973 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3766801748,v1:127.0.0.1:6815/3766801748]", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/1971069295,v1:127.0.0.1:6813/1971069295]", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T17:19:03.974 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:18:02.220321Z", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/1971069295,v1:127.0.0.1:6811/1971069295]", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1971069295,v1:127.0.0.1:6817/1971069295]", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1971069295,v1:127.0.0.1:6815/1971069295]", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:19:03.975 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_clean_epochs": { 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "min_last_epoch_clean": 0, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": { 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "per_pool": [] 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "osd_epochs": [ 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 35 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 39 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_first_committed": 1, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_last_committed": 45, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "crushmap": { 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "devices": [ 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.0", 2026-02-19T17:19:03.976 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.1", 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.2", 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "types": [ 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 0, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd" 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "name": "host" 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 2, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "name": "chassis" 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 3, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "name": "rack" 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.977 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 4, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stderr:report 1458960043 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "name": "row" 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 5, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pdu" 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 6, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pod" 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 7, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "name": "room" 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 8, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: "name": "datacenter" 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.978 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 9, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "name": "zone" 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 10, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "name": "region" 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "name": "root" 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "buckets": [ 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "id": -1, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default", 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.979 INFO:tasks.workunit.client.0.trial119.stdout: "id": -2, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default~ssd", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:03.980 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119~ssd", 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:19:03.981 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "rules": [ 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 0, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "replicated_rule", 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_firstn", 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "tunables": { 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_tries": 0, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_fallback_tries": 0, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "choose_total_tries": 50, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_descend_once": 1, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_vary_r": 1, 2026-02-19T17:19:03.982 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_stable": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "msr_descents": 100, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "msr_collision_tries": 100, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "straw_calc_version": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "allowed_bucket_algs": 54, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "profile": "jewel", 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_tunables": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "legacy_tunables": 0, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "minimum_required_version": "jewel", 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables2": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "has_v2_rules": 0, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables3": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "has_v3_rules": 0, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "has_v4_buckets": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables5": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "has_v5_rules": 0, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "has_msr_rules": 0 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "choose_args": {} 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "fsmap": { 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "btime": "2026-02-19T17:17:53:478770+0000", 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "default_fscid": -1, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "compat": { 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "compat": {}, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "ro_compat": {}, 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "incompat": { 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "feature_1": "base v0.20", 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "feature_2": "client writeable ranges", 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T17:19:03.983 INFO:tasks.workunit.client.0.trial119.stdout: "feature_4": "dir inode in separate object", 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_8": "no anchor table", 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_9": "file layout v2", 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_10": "snaprealm v2", 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_11": "minor log segments", 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "feature_flags": { 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "enable_multiple": true, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "ever_enabled_multiple": true 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "standbys": [], 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "filesystems": [] 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_first_committed": 1, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_last_committed": 1, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "auth": { 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 5, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_secrets": 3 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 32, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_active": 32, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_unknown": 0, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_osd": 3, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "pool_sum": { 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51200, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:19:03.984 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 100, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 100, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:19:03.985 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 512, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 512, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "up": 64, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 64, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 0 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum": { 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 65, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83944, 2026-02-19T17:19:03.986 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2160, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 30, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81697, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488856, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036588544, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2211840, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 453834, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 31270, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83658202 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:19:03.987 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum_by_class": { 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "ssd": { 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 65, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83944, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2160, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 30, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81697, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488856, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036588544, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2211840, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 453834, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 31270, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83658202 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:19:03.988 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "pool_stats": [ 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 32, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51200, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:19:03.989 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 100, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 100, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:19:03.990 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 1220608, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 153552, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 512, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 512, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "up": 64, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 64, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 3 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "osd_stats": [ 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 150323855369 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 38654705676 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 163208757257 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_state": [ 2026-02-19T17:19:03.991 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded", 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num": 31 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded+wait", 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num": 1 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "pool_pg_unavailable_map": [ 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": "1", 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "pgs": [] 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_osd": [ 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 32, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 32, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 32, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 0, 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:19:03.992 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": [ 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": {} 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "servicemap": { 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 3, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:19:01.893411+0000", 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "services": { 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "osd": { 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "daemons": { 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "summary": "", 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "0": { 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "2": { 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.993 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_first_committed": 1, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_last_committed": 36, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "logm_first_committed": 1, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "logm_last_committed": 213, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "paxos": { 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 305, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "last_pn": 0, 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: "accepted_pn": 0 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-19T17:19:03.994 INFO:tasks.workunit.client.0.trial119.stdout:writing non-divergent object existing_4 2026-02-19T17:19:03.995 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:04.170 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:04.170 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.055884+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.170 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054323+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.170 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056615+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054142+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054360+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054333+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056649+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057534+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057400+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057847+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057804+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056636+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056296+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.171 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056663+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054344+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056441+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-19T17:18:58.051106+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056582+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056560+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057408+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056398+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056490+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057520+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054683+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054302+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.172 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054165+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054266+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056249+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057559+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056575+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056337+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056656+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:04.173 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:04.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.iucwQTrhFq 2026-02-19T17:19:04.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:19:04.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-19T17:19:04.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:19:04.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:19:04.202 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:19:04.202 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:19:04.203 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:19:04.203 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:19:04.203 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:19:04.203 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:19:04.203 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:19:04.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:19:04.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:19:04.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:19:04.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:19:04.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:19:04.275 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:19:04.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:19:04.491 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:19:04.491 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:19:04.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:19:04.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:19:04.491 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:19:04.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-19T17:19:04.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-19T17:19:04.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-19T17:19:04.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:19:04.573 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:19:04.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T17:19:04.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-19T17:19:04.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T17:19:04.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-19T17:19:04.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:19:04.638 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:19:04.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-19T17:19:04.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-19T17:19:04.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-163208757259' 2026-02-19T17:19:04.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:19:04.716 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-19T17:19:04.716 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:19:04.717 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:19:04.718 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-19T17:19:04.718 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:19:04.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-19T17:19:04.720 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 150323855371 2026-02-19T17:19:04.720 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-19T17:19:04.720 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:19:04.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-19T17:19:04.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:19:05.931 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:19:05.931 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:19:06.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-19T17:19:06.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:19:06.148 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757259 2026-02-19T17:19:06.148 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:19:06.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:19:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757259 2026-02-19T17:19:06.150 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:19:06.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757259 2026-02-19T17:19:06.152 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757259' 2026-02-19T17:19:06.152 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 163208757259 2026-02-19T17:19:06.153 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:19:06.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-19T17:19:06.366 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:19:06.366 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:06.367 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:06.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-19T17:19:06.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:06.651 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:06.651 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:06.652 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:06.652 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:06.652 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:06.652 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:06.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:06.866 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:06.867 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:06.867 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:07.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:07.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T17:19:07.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T17:19:07.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T17:19:07.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:07.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T17:19:07.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:07.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:07.245 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:07.245 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:07.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:07.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:07.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:07.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:07.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:07.463 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:07.464 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:07.464 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:07.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:07.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:07.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:07.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:07.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:07.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:07.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:07.755 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:07.755 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:08.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:08.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:08.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T17:19:08.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:08.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T17:19:08.240 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:08.241 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:08.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:08.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:08.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:08.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:08.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:08.242 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:08.460 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:08.460 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:08.461 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:08.461 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:08.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:08.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:08.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:08.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:08.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:08.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:08.749 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:08.749 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:08.749 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:09.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:09.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:09.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T17:19:09.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:09.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T17:19:09.434 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:09.435 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:09.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:09.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:09.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:09.435 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:09.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:09.436 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:09.655 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:09.655 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:09.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:09.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:09.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:09.942 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:10.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:10.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:10.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T17:19:10.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:10.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T17:19:11.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:11.027 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:11.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:11.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:11.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:11.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:11.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:11.029 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:11.247 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:11.247 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:11.248 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:11.248 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:11.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:11.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:11.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:11.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:11.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:11.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:11.535 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:11.536 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:11.536 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:11.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:11.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:11.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T17:19:11.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:11.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T17:19:13.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:13.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:13.418 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:13.419 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:13.419 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:13.419 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:13.419 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:13.419 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:13.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:13.632 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:13.633 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:13.633 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:13.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:13.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:13.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:13.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:13.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:13.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:13.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:13.922 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:13.922 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:14.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:14.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:14.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T17:19:14.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:14.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T17:19:17.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:17.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:17.399 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:17.399 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:17.399 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:17.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:17.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:17.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:17.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:17.613 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:17.614 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:17.614 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:17.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:17.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:17.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:17.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:17.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:17.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:17.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:17.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:17.893 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:18.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:18.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:18.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T17:19:18.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:18.180 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T17:19:24.581 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:24.581 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:24.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:24.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:24.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:24.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:24.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:24.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:24.795 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:24.796 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:24.796 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:24.796 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:25.081 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:25.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:25.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:25.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T17:19:25.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:19:25.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T17:19:32.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:19:32.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:19:32.670 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:19:32.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:19:32.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:19:32.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:19:32.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:19:32.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:19:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:19:32.883 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:19:32.883 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:19:32.883 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:19:33.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-19T17:19:33.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:19:33.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:19:33.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:19:33.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:19:33.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:19:33.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:19:33.162 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:19:33.162 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:19:33.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:19:33.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:19:33.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T17:19:33.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_fingerprint": "11b5c8d2-fa1a-45c6-b5c4-ce0516106704", 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "version": "20.3.0-5336-g802bf111", 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "commit": "802bf111cd55e57f5842153d7ba2b8b964aa818a", 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "timestamp": "2026-02-19T17:19:33.718871+0000", 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "tag": "", 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "health": { 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "status": "HEALTH_WARN", 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "checks": { 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "OSDMAP_FLAGS": { 2026-02-19T17:19:33.721 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "count": 17 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [], 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "OSD_DOWN": { 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "message": "1 osds down", 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "message": "osd.1 (root=default,host=trial119) is down" 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "PG_DEGRADED": { 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "count": 32 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.722 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.723 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.724 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.725 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "mutes": [] 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_first_committed": 1, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_last_committed": 1, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "monmap": { 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:17:53.394907Z", 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:17:53.394907Z", 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release": 20, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release_name": "tentacle", 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "election_strategy": 1, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "disallowed_leaders": "", 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": false, 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "tiebreaker_mon": "", 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "removed_ranks": "", 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "features": { 2026-02-19T17:19:33.726 INFO:tasks.workunit.client.0.trial119.stdout: "persistent": [ 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "kraken", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "luminous", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "mimic", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap-prune", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "nautilus", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "octopus", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "pacific", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "elector-pinging", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "quincy", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "reef", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "squid", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "tentacle", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "nvmeof_beacon_diff" 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "optional": [] 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "mons": [ 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "rank": 0, 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "name": "a", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115", 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 0 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.727 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "priority": 0, 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 0, 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "time_added": "2026-02-19T17:17:53:394905+0000", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "crush_location": [] 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "quorum": [ 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: 0 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap": { 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 45, 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:17:53.479033+0000", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:18:58.045060+0000", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "last_up_change": "2026-02-19T17:18:33.454727+0000", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "last_in_change": "2026-02-19T17:18:34.420244+0000", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "flags_num": 5800384, 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "flags_set": [ 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "nodown", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "noin", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "noout", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "pglog_hardlimit", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snapdirs", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "recovery_deletes", 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "sortbitwise" 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.728 INFO:tasks.workunit.client.0.trial119.stdout: "crush_version": 9, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_snapshot": "", 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "pool_max": 1, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "max_osd": 3, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "require_min_compat_client": "luminous", 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "min_compat_client": "jewel", 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "require_osd_release": "tentacle", 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "allow_crimson": false, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "pools": [ 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "pool_name": "test", 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "create_time": "2026-02-19T17:18:05.307992+0000", 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "flags": 1, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "flags_names": "hashpspool", 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "size": 3, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "min_size": 2, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "crush_rule": 0, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_count": 0, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_target": 0, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "is_stretch_pool": false, 2026-02-19T17:19:33.729 INFO:tasks.workunit.client.0.trial119.stdout: "object_hash": 2, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "pg_autoscale_mode": "on", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num": 32, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num": 1, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num_target": 32, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_target": 32, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_pending": 32, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "last_pg_merge_meta": { 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "source_pgid": "0.0", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "ready_epoch": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_started": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "source_version": "0'0", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "target_version": "0'0" 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "last_change": "44", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend": "0", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_preluminous": "44", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "auid": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "snap_mode": "selfmanaged", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "snap_seq": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "snap_epoch": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "pool_snaps": [], 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps": "[]", 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_bytes": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_objects": 0, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "tiers": [], 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "tier_of": -1, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "read_tier": -1, 2026-02-19T17:19:33.730 INFO:tasks.workunit.client.0.trial119.stdout: "write_tier": -1, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "cache_mode": "none", 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_bytes": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_objects": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_flush_age": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_evict_age": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profile": "", 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_params": { 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "type": "none" 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_period": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_count": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "use_gmt_hitset": true, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "min_read_recency_for_promote": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "min_write_recency_for_promote": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_search_last_n": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "grade_table": [], 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "stripe_width": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "expected_num_objects": 0, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "fast_read": false, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "nonprimary_shards": "{}", 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "options": {}, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "application_metadata": {}, 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "read_balance": { 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "score_type": "Fair distribution", 2026-02-19T17:19:33.731 INFO:tasks.workunit.client.0.trial119.stdout: "score_acting": 2.9900000095367432, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "score_stable": 2.9900000095367432, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_score": 0.67000001668930054, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_acting": 2, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "raw_score_stable": 2, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity_weighted": 1, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity": 1, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "average_primary_affinity_weighted": 1 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "osds": [ 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13", 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 5, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 35, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 44, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 29, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.732 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6800", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6801", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6802", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6803", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6806", 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.733 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6807", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6804", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6805", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3366675155 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6801/3366675155", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6803/3366675155", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3366675155", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3366675155", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.734 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df", 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "up": 0, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 0, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 0, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 9, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 21, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 30, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.735 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.736 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3766801748 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/3766801748", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/3766801748", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3766801748", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3766801748", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "exists" 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "10849c2f-a0ab-4827-adee-2ec00a332f47", 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 14, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 38, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 0, 2026-02-19T17:19:33.737 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 31, 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:19:33.738 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1971069295 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/1971069295", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/1971069295", 2026-02-19T17:19:33.739 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1971069295", 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1971069295", 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "osd_xinfo": [ 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:18:29.185557+0000", 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:17:56.910412+0000", 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:18:29.458726+0000", 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:18:00.551725+0000", 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.740 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:18:29.740088+0000", 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:18:04.626157+0000", 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_items": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_primaries": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "pg_temp": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "primary_temp": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "blocklist": {}, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "range_blocklist": {}, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profiles": { 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "default": { 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "m": "2", 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps_queue": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "new_removed_snaps": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "new_purged_snaps": [], 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "crush_node_flags": {}, 2026-02-19T17:19:33.741 INFO:tasks.workunit.client.0.trial119.stdout: "device_class_flags": {}, 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": { 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_enabled": false, 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_bucket_count": 0, 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "degraded_stretch_mode": 0, 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "recovering_stretch_mode": 0, 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_bucket": 0 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "osd_metadata": [ 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6802/3366675155,v1:127.0.0.1:6803/3366675155]", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:19:33.742 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:17:54.468598Z", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6800/3366675155,v1:127.0.0.1:6801/3366675155]", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3366675155,v1:127.0.0.1:6807/3366675155]", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3366675155,v1:127.0.0.1:6805/3366675155]", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:19:33.743 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/3766801748,v1:127.0.0.1:6813/3766801748]", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:19:33.744 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:17:58.148738Z", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/3766801748,v1:127.0.0.1:6811/3766801748]", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3766801748,v1:127.0.0.1:6817/3766801748]", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3766801748,v1:127.0.0.1:6815/3766801748]", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:19:33.745 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/1971069295,v1:127.0.0.1:6813/1971069295]", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:19:33.746 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:18:02.220321Z", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/1971069295,v1:127.0.0.1:6811/1971069295]", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1971069295,v1:127.0.0.1:6817/1971069295]", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1971069295,v1:127.0.0.1:6815/1971069295]", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:19:33.747 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_clean_epochs": { 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "min_last_epoch_clean": 0, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": { 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "per_pool": [] 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "osd_epochs": [ 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 35 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 39 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_first_committed": 1, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_last_committed": 45, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "crushmap": { 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "devices": [ 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.0", 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:33.748 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.1", 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.2", 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "types": [ 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 0, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd" 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "name": "host" 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 2, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "name": "chassis" 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 3, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "name": "rack" 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.749 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 4, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stderr:report 3238660043 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "name": "row" 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 5, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pdu" 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 6, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pod" 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 7, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "name": "room" 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 8, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: "name": "datacenter" 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.750 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 9, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "name": "zone" 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 10, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "name": "region" 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "name": "root" 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "buckets": [ 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "id": -1, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default", 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.751 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "id": -2, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default~ssd", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:33.752 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119~ssd", 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:33.753 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "rules": [ 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 0, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "replicated_rule", 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_firstn", 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:19:33.754 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "tunables": { 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_tries": 0, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_fallback_tries": 0, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "choose_total_tries": 50, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_descend_once": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_vary_r": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_stable": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "msr_descents": 100, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "msr_collision_tries": 100, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "straw_calc_version": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "allowed_bucket_algs": 54, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "profile": "jewel", 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_tunables": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "legacy_tunables": 0, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "minimum_required_version": "jewel", 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables2": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "has_v2_rules": 0, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables3": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "has_v3_rules": 0, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "has_v4_buckets": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables5": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "has_v5_rules": 0, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "has_msr_rules": 0 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "choose_args": {} 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "fsmap": { 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:19:33.755 INFO:tasks.workunit.client.0.trial119.stdout: "btime": "2026-02-19T17:17:53:478770+0000", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "default_fscid": -1, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "compat": { 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "compat": {}, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "ro_compat": {}, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "incompat": { 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_1": "base v0.20", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_2": "client writeable ranges", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_4": "dir inode in separate object", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_8": "no anchor table", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_9": "file layout v2", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_10": "snaprealm v2", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_11": "minor log segments", 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "feature_flags": { 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "enable_multiple": true, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "ever_enabled_multiple": true 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "standbys": [], 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "filesystems": [] 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_first_committed": 1, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_last_committed": 1, 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "auth": { 2026-02-19T17:19:33.756 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 5, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_secrets": 3 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 32, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_active": 32, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_unknown": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_osd": 3, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "pool_sum": { 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51688, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:19:33.757 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:19:33.758 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 513, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 513, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "up": 64, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 64, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 0 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum": { 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 65, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83944, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2160, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 30, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81697, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488856, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036588544, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2211840, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 454810, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:33.759 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 31270, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83658202 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum_by_class": { 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "ssd": { 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 65, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:19:33.760 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83944, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2160, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 30, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81697, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488856, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036588544, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2211840, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 454810, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 31270, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83658202 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.761 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "pool_stats": [ 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 32, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 51688, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 100, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 300, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 100, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 100, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:19:33.762 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 1220608, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 154528, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 513, 2026-02-19T17:19:33.763 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 513, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "up": 64, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 64, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 3 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "osd_stats": [ 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 150323855377 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 38654705676 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 163208757264 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_state": [ 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded", 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "num": 32 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "pool_pg_unavailable_map": [ 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": "1", 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "pgs": [] 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_osd": [ 2026-02-19T17:19:33.764 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 32, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 32, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 32, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 0, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": [ 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": {} 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "servicemap": { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 4, 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:19:31.897893+0000", 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "services": { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "osd": { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "daemons": { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "summary": "", 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "2": { 2026-02-19T17:19:33.765 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_first_committed": 1, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_last_committed": 50, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "logm_first_committed": 1, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "logm_last_committed": 276, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "paxos": { 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 382, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "last_pn": 0, 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: "accepted_pn": 0 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T17:19:33.766 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery 2026-02-19T17:19:33.767 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-19T17:19:33.767 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.055884+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054323+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056615+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054142+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054360+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054333+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056649+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057534+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057400+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057847+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057804+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056636+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056296+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056663+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054344+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056441+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:19:06.525836+0000 28'100 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:00.846144+0000 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056582+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.936 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:18:58.056560+0000 45'101 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057408+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056398+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056490+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057520+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054683+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054302+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054165+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054266+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056249+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057559+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056575+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056337+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056656+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:33.937 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:33.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:19:33.946 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-19T17:19:33.946 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:19:33.946 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:19:33.946 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:19:33.946 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:19:33.946 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:19:33.946 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:19:33.947 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-19T17:19:33.947 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T17:19:34.004 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:19:34.010 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-19T17:19:34.010 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-19T17:19:34.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T17:19:34.067 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:19:34.072 INFO:tasks.workunit.client.0.trial119.stdout:revive divergent 1 2026-02-19T17:19:34.073 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-19T17:19:34.073 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:34.291 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:34.291 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.055884+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.291 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054323+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.291 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056615+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.291 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054142+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.291 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054360+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.291 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054333+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056649+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057534+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057400+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057847+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057804+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056636+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056296+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056663+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054344+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056441+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.292 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:19:06.525836+0000 28'100 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:00.846144+0000 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056582+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:18:58.056560+0000 45'101 45:146 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057408+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056398+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056490+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057520+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054683+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054302+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.293 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054165+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054266+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056249+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057559+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056575+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056337+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056656+0000 28'100 45:145 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:34.294 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:34.295 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:34.301 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-19T17:19:34.614 INFO:tasks.workunit.client.0.trial119.stderr:noup is set 2026-02-19T17:19:34.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:19:34.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:19:34.633 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:19:34.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:19:34.635 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:19:34.635 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:19:34.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:19:34.636 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:19:34.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:19:34.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:19:34.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:19:34.637 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:19:34.655 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:34.646+0000 7f3001645a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:19:34.656 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:34.650+0000 7f3001645a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:19:34.657 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:34.650+0000 7f3001645a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:19:34.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T17:19:34.846 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-19T17:19:35.065 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:35.058+0000 7f3001645a40 -1 Falling back to public interface 2026-02-19T17:19:35.753 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:35.746+0000 7f3001645a40 -1 osd.1 28 log_to_monitors true 2026-02-19T17:19:39.847 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery divergent 2026-02-19T17:19:39.847 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-19T17:19:39.847 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:40.050 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.055884+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054323+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:24.933918+0000 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056615+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054142+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:07.867778+0000 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054360+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:19.874058+0000 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054333+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:04.884560+0000 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056649+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057534+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057400+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057847+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057804+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056636+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056296+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056663+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054344+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:18.899877+0000 0 0 2026-02-19T17:19:40.051 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056441+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:19:06.525836+0000 28'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:00.846144+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056582+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:35.010786+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:18:58.056560+0000 45'101 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057408+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056398+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:32.041514+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056490+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057520+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054683+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:25.937233+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054302+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:15.911238+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054165+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:03.842468+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054266+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:17.888971+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056249+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057559+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056575+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056337+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:30.999410+0000 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056656+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:40.052 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:40.053 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:40.062 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-19T17:19:40.062 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:19:40.062 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:19:40.062 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:19:40.062 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:19:40.062 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:19:40.062 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:19:40.063 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-19T17:19:40.063 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T17:19:40.129 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:19:40.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-19T17:19:40.452 INFO:tasks.workunit.client.0.trial119.stderr:noup is unset 2026-02-19T17:19:40.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-19T17:19:40.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:19:40.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:19:40.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:19:40.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:19:40.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:19:40.467 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:19:40.468 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:19:40.468 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:19:40.468 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:19:40.683 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 35 up_thru 44 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/3366675155,v1:127.0.0.1:6801/3366675155] [v2:127.0.0.1:6802/3366675155,v1:127.0.0.1:6803/3366675155] exists,up 1d5a09d4-f2ec-4b49-9ef1-b918a0cf9a13 2026-02-19T17:19:40.684 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:19:40.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:19:40.686 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:19:40.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:19:40.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:19:40.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:19:40.901 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/211149650,v1:127.0.0.1:6819/211149650] [v2:127.0.0.1:6820/211149650,v1:127.0.0.1:6821/211149650] exists,up e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:19:40.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:19:40.904 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:19:40.904 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:19:40.905 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:19:40.905 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:19:41.114 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/1971069295,v1:127.0.0.1:6811/1971069295] [v2:127.0.0.1:6812/1971069295,v1:127.0.0.1:6813/1971069295] exists,up 10849c2f-a0ab-4827-adee-2ec00a332f47 2026-02-19T17:19:41.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:19:41.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:19:41.115 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:19:41.115 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:41.312 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:41.312 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.055884+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.312 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054323+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:24.933918+0000 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056615+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054142+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:07.867778+0000 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054360+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:19.874058+0000 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054333+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:04.884560+0000 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056649+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057534+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057400+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057847+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.313 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057804+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.314 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056636+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.314 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056296+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.314 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056663+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.314 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054344+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:18.899877+0000 0 0 2026-02-19T17:19:41.314 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056441+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.314 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:19:06.525836+0000 28'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:00.846144+0000 0 0 2026-02-19T17:19:41.314 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056582+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:35.010786+0000 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:18:58.056560+0000 45'101 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057408+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056398+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:32.041514+0000 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056490+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057520+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054683+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:25.937233+0000 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054302+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:15.911238+0000 0 0 2026-02-19T17:19:41.315 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054165+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:03.842468+0000 0 0 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054266+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:17.888971+0000 0 0 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056249+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057559+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056575+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056337+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:30.999410+0000 0 0 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056656+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:41.316 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:41.317 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:41.321 INFO:tasks.workunit.client.0.trial119.stdout:wait for peering 2026-02-19T17:19:41.322 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-19T17:19:41.322 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.055884+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054323+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:24.933918+0000 0 0 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056615+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054142+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:07.867778+0000 0 0 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054360+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:19.874058+0000 0 0 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054333+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:04.884560+0000 0 0 2026-02-19T17:19:41.531 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056649+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057534+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057400+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057847+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057804+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056636+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056296+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056663+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054344+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:18.899877+0000 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056441+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.532 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:19:06.525836+0000 28'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:00.846144+0000 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056582+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:35.010786+0000 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:18:58.056560+0000 45'101 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057408+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056398+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:32.041514+0000 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056490+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057520+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054683+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:25.937233+0000 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054302+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:15.911238+0000 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054165+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:03.842468+0000 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054266+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:17.888971+0000 0 0 2026-02-19T17:19:41.533 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056249+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.534 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057559+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.534 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056575+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.534 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056337+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:30.999410+0000 0 0 2026-02-19T17:19:41.534 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056656+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.534 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:41.534 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:41.534 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:41.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.gJstai4wSg 2026-02-19T17:19:41.562 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.gJstai4wSg 2026-02-19T17:19:41.562 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.iucwQTrhFq 2026-02-19T17:19:41.563 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-19T17:19:41.563 INFO:tasks.workunit.client.0.trial119.stdout:killing divergent 1 2026-02-19T17:19:41.564 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.055884+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054323+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:24.933918+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056615+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054142+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:07.867778+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054360+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:19.874058+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054333+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:04.884560+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056649+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057534+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057400+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057847+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057804+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056636+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056296+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056663+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054344+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:18.899877+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056441+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:19:06.525836+0000 28'100 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:00.846144+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056582+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:35.010786+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-19T17:18:58.056560+0000 45'101 48:151 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057408+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056398+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:32.041514+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056490+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057520+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054683+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:25.937233+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054302+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:15.911238+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054165+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:03.842468+0000 0 0 2026-02-19T17:19:41.764 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.054266+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:17.888971+0000 0 0 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056249+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.057559+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056575+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056337+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 user requested scrub scheduled @ 2026-02-19T17:20:30.999410+0000 0 0 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:18:58.056656+0000 28'100 48:150 [0,2] 0 [0,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:41.765 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:41.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T17:19:41.775 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:19:41.775 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:19:41.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:19:41.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:19:41.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:19:41.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:19:41.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.20601.out 2026-02-19T17:19:41.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.20601.out 2026-02-19T17:19:41.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T17:19:41.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T17:19:41.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T17:19:41.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T17:19:41.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T17:19:41.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.20601.out 2026-02-19T17:19:42.092 INFO:tasks.workunit.client.0.trial119.stderr:Exporting 1.0 info 1.0( v 28'100 (28'90,28'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-19T17:19:42.092 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-19T17:19:42.093 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-19T17:19:42.093 INFO:tasks.workunit.client.0.trial119.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-19T17:19:42.093 INFO:tasks.workunit.client.0.trial119.stderr:Export successful 2026-02-19T17:19:42.094 INFO:tasks.workunit.client.0.trial119.stdout: marking collection for removal 2026-02-19T17:19:42.094 INFO:tasks.workunit.client.0.trial119.stdout:setting '_remove' omap key 2026-02-19T17:19:42.094 INFO:tasks.workunit.client.0.trial119.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-19T17:19:42.094 INFO:tasks.workunit.client.0.trial119.stderr:Remove successful 2026-02-19T17:19:42.188 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.20601.out 2026-02-19T17:19:42.188 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T17:19:42.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T17:19:42.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T17:19:42.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T17:19:42.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T17:19:42.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.20601.out 2026-02-19T17:19:42.368 INFO:tasks.workunit.client.0.trial119.stdout:get_pg_num_history pg_num_history pg_num_history(e51 pg_nums {1={21=1,44=32}} deleted_pools ) 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:Importing pgid 1.0 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:snapset 0={} 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:write_pg epoch 51 info 1.0( v 28'100 (28'90,28'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-19T17:19:42.369 INFO:tasks.workunit.client.0.trial119.stdout:Import successful 2026-02-19T17:19:42.459 INFO:tasks.workunit.client.0.trial119.stdout:reviving divergent 1 2026-02-19T17:19:42.460 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-19T17:19:42.460 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:19:42.658 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:19:42.658 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453499+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453396+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453422+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459402+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459586+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459354+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.453631+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459553+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459614+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459544+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459557+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459379+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459358+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459307+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459526+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453028+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.659 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453611+0000 28'106 51:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459524+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459452+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.459370+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-19T17:19:40.451399+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.452771+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.452920+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.451903+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.452969+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453241+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453617+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.453594+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.451643+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.451894+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.452809+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-19T17:19:40.452691+0000 28'106 51:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:19:42.660 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:19:42.661 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:19:42.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-19T17:19:42.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:19:42.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:19:42.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:19:42.669 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:19:42.670 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:19:42.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:19:42.672 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:19:42.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:19:42.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:19:42.672 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:19:42.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:19:42.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:19:42.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:19:42.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:19:42.692 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:42.686+0000 7fe8a10d8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:19:42.693 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:42.686+0000 7fe8a10d8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:19:42.694 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:42.686+0000 7fe8a10d8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:19:42.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:19:42.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:19:42.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:19:42.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:19:42.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:19:42.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:19:42.883 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:19:42.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:19:42.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:19:42.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:19:43.073 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:43.066+0000 7fe8a10d8a40 -1 Falling back to public interface 2026-02-19T17:19:43.100 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/211149650,v1:127.0.0.1:6819/211149650] [v2:127.0.0.1:6820/211149650,v1:127.0.0.1:6821/211149650] exists,up e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df 2026-02-19T17:19:43.101 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:19:43.101 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:19:43.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:19:43.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-19T17:19:43.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:19:43.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:19:43.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:19:43.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:19:43.102 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:19:43.103 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:19:43.103 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:19:43.103 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:19:43.103 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:19:43.311 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/211149650,v1:127.0.0.1:6819/211149650] [v2:127.0.0.1:6820/211149650,v1:127.0.0.1:6821/211149650] exists,up e8b5c9b8-87ba-4ee7-92a0-d1eced25f9df 2026-02-19T17:19:43.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:19:43.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:19:43.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:19:43.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-19T17:19:43.815 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:19:43.806+0000 7fe8a10d8a40 -1 osd.1 51 log_to_monitors true 2026-02-19T17:20:03.314 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-19T17:20:03.314 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:20:03.314 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:20:03.315 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:20:03.315 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:03.315 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:03.315 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:20:03.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-19T17:20:03.316 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.1.asok dump_ops_in_flight 2026-02-19T17:20:03.371 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:20:03.372 INFO:tasks.workunit.client.0.trial119.stdout: "ops": [], 2026-02-19T17:20:03.372 INFO:tasks.workunit.client.0.trial119.stdout: "num_ops": 0 2026-02-19T17:20:03.372 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:20:03.377 INFO:tasks.workunit.client.0.trial119.stdout:allowing recovery 2026-02-19T17:20:03.377 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-19T17:20:03.378 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:20:03.589 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:20:03.589 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060695+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.589 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:52.060128+0000 28'100 62:172 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.590 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.060204+0000 28'100 62:148 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.590 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.059938+0000 28'100 63:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.590 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:52.060230+0000 28'100 65:180 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.590 INFO:tasks.workunit.client.0.trial119.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.060908+0000 28'100 62:148 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.590 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T17:19:53.832514+0000 28'100 63:185 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:53.832450+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-21T03:12:22.712953+0000 3 0 2026-02-19T17:20:03.590 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060685+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.591 INFO:tasks.workunit.client.0.trial119.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-19T17:19:52.060079+0000 51'101 62:164 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.591 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.061078+0000 28'100 62:148 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.591 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:44.185786+0000 28'100 63:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.591 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.060080+0000 28'100 63:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.591 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:52.060146+0000 28'100 65:180 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.592 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-19T17:19:57.800338+0000 28'100 63:185 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:57.800288+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:42:05.946218+0000 3 0 2026-02-19T17:20:03.592 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.060198+0000 28'100 62:148 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.592 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:44.182276+0000 28'100 63:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.592 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T17:19:52.797464+0000 28'100 63:184 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:52.797422+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-21T04:38:00.139615+0000 3 0 2026-02-19T17:20:03.592 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.061089+0000 28'100 62:148 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.592 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-19T17:19:52.059819+0000 45'101 62:173 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.592 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060438+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T17:19:54.815376+0000 28'100 63:185 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:54.815330+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-21T03:24:34.095231+0000 3 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.058985+0000 28'100 62:148 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-19T17:20:00.117905+0000 28'100 65:188 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-19T17:20:00.117859+0000 0'0 2026-02-19T17:18:05.330641+0000 0 1 periodic scrub scheduled @ 2026-02-20T18:27:10.631465+0000 1 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.060413+0000 28'100 63:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:44.183099+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.060353+0000 28'100 62:148 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.16 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T17:19:53.185197+0000 28'100 62:180 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-19T17:19:53.185136+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T21:59:01.906388+0000 4 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060430+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-19T17:19:50.360663+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.593 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:44.181876+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.594 INFO:tasks.workunit.client.0.trial119.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-19T17:19:54.361153+0000 28'100 62:156 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-19T17:19:54.361108+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T18:27:32.790736+0000 2 0 2026-02-19T17:20:03.594 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T17:19:59.138794+0000 28'100 65:188 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-19T17:19:59.138752+0000 0'0 2026-02-19T17:18:05.330641+0000 0 1 periodic scrub scheduled @ 2026-02-21T01:36:47.328483+0000 4 0 2026-02-19T17:20:03.594 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.060417+0000 28'100 63:175 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:03.594 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:20:03.594 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:20:03.595 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:20:03.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-19T17:20:03.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T17:20:03.684 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:20:03.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-19T17:20:03.691 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T17:20:03.773 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:20:03.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-19T17:20:03.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T17:20:03.861 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:20:03.868 INFO:tasks.workunit.client.0.trial119.stdout:reading divergent objects 2026-02-19T17:20:03.869 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-19T17:20:03.869 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-19T17:20:04.079 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:20:04.079 INFO:tasks.workunit.client.0.trial119.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060695+0000 28'100 66:180 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.079 INFO:tasks.workunit.client.0.trial119.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:20:00.060198+0000 28'100 66:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.079 INFO:tasks.workunit.client.0.trial119.stdout:1.1d 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T17:20:02.369443+0000 28'100 66:166 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-19T17:20:02.369390+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T17:32:15.740709+0000 4 0 2026-02-19T17:20:04.079 INFO:tasks.workunit.client.0.trial119.stdout:1.b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.059938+0000 28'100 66:182 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.079 INFO:tasks.workunit.client.0.trial119.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:52.060230+0000 28'100 65:180 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.079 INFO:tasks.workunit.client.0.trial119.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-19T17:20:01.349160+0000 28'100 66:167 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-19T17:20:01.349103+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:54:31.991454+0000 5 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T17:19:53.832514+0000 28'100 66:193 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:53.832450+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-21T00:56:36.193447+0000 3 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060685+0000 28'100 66:180 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-19T17:20:00.059777+0000 51'101 66:175 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.061078+0000 28'100 66:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:44.185786+0000 28'100 66:184 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.060080+0000 28'100 66:182 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:52.060146+0000 28'100 65:180 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.c 3 0 0 0 0 1536 0 0 14 86 14 active+clean 2026-02-19T17:19:57.800338+0000 28'100 66:193 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:57.800288+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T22:26:42.863874+0000 3 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.060198+0000 28'100 66:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:44.182276+0000 28'100 66:184 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.080 INFO:tasks.workunit.client.0.trial119.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T17:19:52.797464+0000 28'100 66:192 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:52.797422+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-21T01:58:30.829173+0000 3 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.061089+0000 28'100 66:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.e 3 0 0 0 0 2088 0 0 14 87 14 active+clean 2026-02-19T17:20:00.059705+0000 45'101 66:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060438+0000 28'100 66:180 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-19T17:19:54.815376+0000 28'100 66:193 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:54.815330+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:44:14.982517+0000 3 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-19T17:19:58.380012+0000 28'100 66:166 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-19T17:19:58.379971+0000 0'0 2026-02-19T17:18:05.330641+0000 0 1 periodic scrub scheduled @ 2026-02-20T20:19:53.559081+0000 3 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-19T17:20:00.117905+0000 28'100 65:188 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-19T17:20:00.117859+0000 0'0 2026-02-19T17:18:05.330641+0000 0 1 periodic scrub scheduled @ 2026-02-20T18:27:10.631465+0000 1 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.060413+0000 28'100 66:182 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:44.183099+0000 28'100 66:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:50.060353+0000 28'100 66:159 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:20:00.060026+0000 28'100 66:174 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-19T17:19:53.185136+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-19T17:19:54.060430+0000 28'100 66:180 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-19T17:19:50.360663+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.081 INFO:tasks.workunit.client.0.trial119.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:44.181876+0000 28'100 66:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.082 INFO:tasks.workunit.client.0.trial119.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-19T17:19:54.361153+0000 28'100 66:167 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-19T17:19:54.361108+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 periodic scrub scheduled @ 2026-02-21T00:21:16.500773+0000 2 0 2026-02-19T17:20:04.082 INFO:tasks.workunit.client.0.trial119.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-19T17:19:59.138794+0000 28'100 65:188 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-19T17:19:59.138752+0000 0'0 2026-02-19T17:18:05.330641+0000 0 1 periodic scrub scheduled @ 2026-02-21T01:36:47.328483+0000 4 0 2026-02-19T17:20:04.082 INFO:tasks.workunit.client.0.trial119.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-19T17:19:54.060417+0000 28'100 66:183 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-19T17:18:05.330641+0000 0'0 2026-02-19T17:18:05.330641+0000 0 0 queued for scrub 0 0 2026-02-19T17:20:04.082 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:20:04.082 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:20:04.082 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:20:04.089 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-19T17:20:04.090 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-19T17:20:04.091 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:20:04.092 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T17:20:04.115 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:20:04.115 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T17:20:04.145 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:20:04.145 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T17:20:04.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:20:04.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T17:20:04.197 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-19T17:20:04.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:20:04.199 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-19T17:20:04.218 INFO:tasks.workunit.client.0.trial119.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-19T17:20:04.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-19T17:20:04.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-19T17:20:04.244 INFO:tasks.workunit.client.0.trial119.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-19T17:20:04.246 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-19T17:20:04.248 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-19T17:20:04.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:20:04.253 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-19T17:18:18.601655+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:20:04.253 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 20 _merge_object_divergent_entries: keeping 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-19T17:18:18.601655+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:20:04.253 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:20:04.253 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-19T17:20:04.253 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'104 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-19T17:18:18.601655+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.818+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'89 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-19T17:18:18.605851+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-19T17:18:18.605851+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 10 _merge_object_divergent_entries: more recent entry found: 45'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4656.0:1 2026-02-19T17:19:04.197853+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4535.0:1 2026-02-19T17:18:18.599177+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:20:04.254 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4535.0:1 2026-02-19T17:18:18.599177+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fdc5bd640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-19T17:18:18.601386+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 20 _merge_object_divergent_entries: keeping 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-19T17:18:18.601386+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-19T17:20:04.255 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'103 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-19T17:18:18.601386+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:20:04.256 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-19T17:20:04.256 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-19T17:20:04.256 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4534.0:1 2026-02-19T17:18:18.599035+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:20:04.256 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4534.0:1 2026-02-19T17:18:18.599035+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:20:04.261 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:20:04.261 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-19T17:20:04.261 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-19T17:20:04.261 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe1dc8640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-19T17:20:04.261 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T17:18:18.605325+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:20:04.261 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T17:18:18.605325+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:20:04.261 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-19T17:20:04.262 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-19T17:20:04.262 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-19T17:20:04.262 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:20:04.262 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-19T17:20:04.262 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-19T17:18:18.605325+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-19T17:20:04.262 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-19T17:20:04.262 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:19:40.822+0000 7f2fe2dca640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'84 2026-02-19T17:20:04.263 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-19T17:20:04.263 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:20:04.266 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-19T17:20:04.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:20:04.270 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-19T17:20:04.270 INFO:tasks.workunit.client.0.trial119.stdout:success 2026-02-19T17:20:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.20601.out 2026-02-19T17:20:04.271 INFO:tasks.workunit.client.0.trial119.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.20601.out': No such file or directory 2026-02-19T17:20:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-19T17:20:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T17:20:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T17:20:04.529 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' does not exist 2026-02-19T17:20:04.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-19T17:20:04.539 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:20:04.539 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:20:04.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:20:04.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:20:04.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:20:09.857 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:20:09.857 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T17:20:09.857 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:20:09.857 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:20:09.857 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:20:09.858 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:20:09.858 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:20:09.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:20:09.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:20:09.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:20:09.864 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:20:09.865 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:20:09.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:20:09.866 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:20:09.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:20:09.868 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:20:09.868 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:20:09.869 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:20:09.869 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:20:09.870 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:20:09.870 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:20:09.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:20:09.872 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:20:09.872 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:20:09.897 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:20:09.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:09.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:09.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:20:09.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:20:09.901 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:20:09.901 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:20:09.901 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:20:09.901 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:20:09.901 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:20:09.901 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:20:09.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:20:09.903 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:20:09.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:20:09.904 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:20:09.905 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:20:09.906 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:20:09.906 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:20:09.907 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:20:09.907 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:20:09.907 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:20:09.908 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:20:09.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:20:09.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:20:09.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:20:09.912 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:20:09.912 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:09.912 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:09.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:20:09.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:20:09.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:20:09.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-19T17:20:09.915 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:20:09.915 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:09.915 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:09.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.20601 2026-02-19T17:20:09.916 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:20:09.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T17:20:09.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:20:09.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-19T17:20:09.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-19T17:20:09.917 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-19T17:20:09.918 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-19T17:20:09.918 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-19T17:20:09.918 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-19T17:20:09.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.WrwA8zssKl 2026-02-19T17:20:09.919 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.WrwA8zssKl bs=512 count=1 2026-02-19T17:20:09.920 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:20:09.920 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:20:09.921 INFO:tasks.workunit.client.0.trial119.stderr:512 bytes copied, 8.9345e-05 s, 5.7 MB/s 2026-02-19T17:20:09.921 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:09.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.WrwA8zssKl 2026-02-19T17:20:09.921 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-19T17:20:09.921 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-19T17:20:09.922 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-19T17:20:09.923 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.jPE6REq3Kn 2026-02-19T17:20:09.923 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.jPE6REq3Kn bs=1000 count=1 2026-02-19T17:20:09.924 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records in 2026-02-19T17:20:09.924 INFO:tasks.workunit.client.0.trial119.stderr:1+0 records out 2026-02-19T17:20:09.924 INFO:tasks.workunit.client.0.trial119.stderr:1000 bytes (1.0 kB) copied, 7.7824e-05 s, 12.8 MB/s 2026-02-19T17:20:09.924 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.jPE6REq3Kn 2026-02-19T17:20:09.925 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.jPE6REq3Kn 2026-02-19T17:20:09.925 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-19T17:20:09.925 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-19T17:20:09.926 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:20:09.928 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-19T17:20:09.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-19T17:20:09.955 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:20:09.955 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:20:09.955 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:20:09.955 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:20:09.955 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:09.955 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:09.956 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:09.956 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:20:09.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:20:09.986 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:20:09.986 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:20:09.986 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:20:09.986 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:20:09.987 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:20:09.988 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:20:09.988 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:20:09.988 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:20:09.988 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:20:09.988 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:09.988 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:09.989 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:20:09.989 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:20:09.989 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get fsid 2026-02-19T17:20:10.044 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:20:10.044 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:20:10.044 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:20:10.044 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:20:10.044 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:20:10.044 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:20:10.044 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:20:10.045 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:20:10.045 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:20:10.046 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:10.046 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:10.046 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-mon.a.asok 2026-02-19T17:20:10.046 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:20:10.046 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.20601/ceph-mon.a.asok config get mon_host 2026-02-19T17:20:10.099 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-19T17:20:10.099 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-19T17:20:10.099 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:20:10.099 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:20:10.099 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:20:10.099 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-19T17:20:10.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:20:10.209 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:20:10.210 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:20:10.210 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:20:10.211 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:20:10.211 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:10.211 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:10.211 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:10.211 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:20:10.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:20:10.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:10.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-19T17:20:10.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:20:10.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:20:10.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:20:10.238 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:20:10.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2b6b831d-9cc0-4674-aa88-afd959b56da2 2026-02-19T17:20:10.239 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 2b6b831d-9cc0-4674-aa88-afd959b56da2 2026-02-19T17:20:10.240 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2b6b831d-9cc0-4674-aa88-afd959b56da2' 2026-02-19T17:20:10.240 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:20:10.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBKRpdpRtLJDhAA6hN6L9WSl+W56NzcO3j7sQ== 2026-02-19T17:20:10.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBKRpdpRtLJDhAA6hN6L9WSl+W56NzcO3j7sQ=="}' 2026-02-19T17:20:10.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2b6b831d-9cc0-4674-aa88-afd959b56da2 -i td/divergent-priors/0/new.json 2026-02-19T17:20:10.366 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:20:10.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-19T17:20:10.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBKRpdpRtLJDhAA6hN6L9WSl+W56NzcO3j7sQ== --osd-uuid 2b6b831d-9cc0-4674-aa88-afd959b56da2 2026-02-19T17:20:10.394 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:10.385+0000 7f5013434a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:10.395 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:10.389+0000 7f5013434a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:10.396 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:10.389+0000 7f5013434a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:10.397 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:10.389+0000 7f5013434a40 -1 bdev(0x55a6a9ae0400 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:20:10.397 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:10.389+0000 7f5013434a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-19T17:20:11.131 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-19T17:20:11.132 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:20:11.132 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:20:11.133 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:20:11.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:20:11.256 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:20:11.257 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:20:11.257 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:20:11.257 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:20:11.257 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:20:11.258 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:20:11.286 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:11.277+0000 7fa5b8ce6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:11.288 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:11.281+0000 7fa5b8ce6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:11.290 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:11.281+0000 7fa5b8ce6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:20:11.368 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:20:11.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:11.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:20:11.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:20:11.829 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:11.825+0000 7fa5b8ce6a40 -1 Falling back to public interface 2026-02-19T17:20:12.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:20:12.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:12.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:20:12.486 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:20:12.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:12.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:20:12.595 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:20:12.770 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:12.765+0000 7fa5b8ce6a40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:20:13.597 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:20:13.597 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:13.597 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:20:13.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:20:13.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:13.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:20:13.807 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3081487813,v1:127.0.0.1:6801/3081487813] [v2:127.0.0.1:6802/3081487813,v1:127.0.0.1:6803/3081487813] exists,up 2b6b831d-9cc0-4674-aa88-afd959b56da2 2026-02-19T17:20:13.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:20:13.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:20:13.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:20:13.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:13.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-19T17:20:13.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:20:13.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:20:13.812 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:20:13.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:20:13.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:20:13.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:20:13.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:20:13.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:20:13.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:20:13.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:20:13.814 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:20:13.815 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cbf446a6-b895-4ce0-a417-62785f1f4f57 2026-02-19T17:20:13.815 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 cbf446a6-b895-4ce0-a417-62785f1f4f57' 2026-02-19T17:20:13.815 INFO:tasks.workunit.client.0.trial119.stdout:add osd1 cbf446a6-b895-4ce0-a417-62785f1f4f57 2026-02-19T17:20:13.815 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:20:13.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBNRpdpPnYPMRAAcwPoqWVTZnh502QFgfh/hg== 2026-02-19T17:20:13.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBNRpdpPnYPMRAAcwPoqWVTZnh502QFgfh/hg=="}' 2026-02-19T17:20:13.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cbf446a6-b895-4ce0-a417-62785f1f4f57 -i td/divergent-priors/1/new.json 2026-02-19T17:20:14.044 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:20:14.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-19T17:20:14.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBNRpdpPnYPMRAAcwPoqWVTZnh502QFgfh/hg== --osd-uuid cbf446a6-b895-4ce0-a417-62785f1f4f57 2026-02-19T17:20:14.075 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:14.069+0000 7fb22ff53a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:14.077 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:14.073+0000 7fb22ff53a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:14.078 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:14.073+0000 7fb22ff53a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:14.078 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:14.073+0000 7fb22ff53a40 -1 bdev(0x564074798400 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-19T17:20:14.078 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:14.073+0000 7fb22ff53a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-19T17:20:14.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-19T17:20:14.742 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:20:14.743 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T17:20:14.743 INFO:tasks.workunit.client.0.trial119.stdout:adding osd1 key to auth repository 2026-02-19T17:20:14.744 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:20:15.032 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:20:15.032 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T17:20:15.032 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:20:15.032 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:20:15.032 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:20:15.032 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:20:15.052 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:15.049+0000 7fa5dfc9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:15.054 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:15.049+0000 7fa5dfc9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:15.055 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:15.049+0000 7fa5dfc9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:15.248 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T17:20:15.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:20:15.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:20:15.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:20:15.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:20:15.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:15.249 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:20:15.249 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:20:15.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:15.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:20:15.425 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:15.421+0000 7fa5dfc9fa40 -1 Falling back to public interface 2026-02-19T17:20:15.462 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:20:16.033 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:16.029+0000 7fa5dfc9fa40 -1 osd.1 0 log_to_monitors true 2026-02-19T17:20:16.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:20:16.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:16.463 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:20:16.464 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:20:16.464 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:16.464 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:20:16.673 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/314207968,v1:127.0.0.1:6811/314207968] [v2:127.0.0.1:6812/314207968,v1:127.0.0.1:6813/314207968] exists,up cbf446a6-b895-4ce0-a417-62785f1f4f57 2026-02-19T17:20:16.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:20:16.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:20:16.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:20:16.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:16.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:20:16.675 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:20:16.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:20:16.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:20:16.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:20:16.677 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:20:16.677 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:20:16.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab 2026-02-19T17:20:16.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab' 2026-02-19T17:20:16.678 INFO:tasks.workunit.client.0.trial119.stdout:add osd2 f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab 2026-02-19T17:20:16.678 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:20:16.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBQRpdpTsUjKRAAEMMpTtuilQabNr+yn6ievg== 2026-02-19T17:20:16.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBQRpdpTsUjKRAAEMMpTtuilQabNr+yn6ievg=="}' 2026-02-19T17:20:16.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab -i td/divergent-priors/2/new.json 2026-02-19T17:20:16.914 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:20:16.923 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-19T17:20:16.924 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBQRpdpTsUjKRAAEMMpTtuilQabNr+yn6ievg== --osd-uuid f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab 2026-02-19T17:20:16.944 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:16.941+0000 7ffa27429a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:16.946 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:16.941+0000 7ffa27429a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:16.947 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:16.941+0000 7ffa27429a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:16.947 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:16.941+0000 7ffa27429a40 -1 bdev(0x55f52e0de400 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-19T17:20:16.948 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:16.945+0000 7ffa27429a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-19T17:20:17.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-19T17:20:17.635 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:20:17.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T17:20:17.636 INFO:tasks.workunit.client.0.trial119.stdout:adding osd2 key to auth repository 2026-02-19T17:20:17.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:20:17.924 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:20:17.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T17:20:17.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:20:17.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:20:17.926 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:20:17.927 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:20:17.953 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:17.949+0000 7f1656088a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:17.955 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:17.949+0000 7f1656088a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:17.956 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:17.953+0000 7f1656088a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:18.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T17:20:18.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:20:18.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:20:18.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:20:18.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:20:18.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:18.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:20:18.139 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:20:18.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:18.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:20:18.345 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:18.341+0000 7f1656088a40 -1 Falling back to public interface 2026-02-19T17:20:18.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:20:18.982 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:18.977+0000 7f1656088a40 -1 osd.2 0 log_to_monitors true 2026-02-19T17:20:19.351 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:20:19.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:19.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:20:19.352 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:20:19.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:19.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:20:19.566 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:20:20.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:20:20.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:20.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:20:20.568 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:20:20.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:20.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:20:20.777 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2522098242,v1:127.0.0.1:6819/2522098242] [v2:127.0.0.1:6820/2522098242,v1:127.0.0.1:6821/2522098242] exists,up f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab 2026-02-19T17:20:20.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:20:20.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:20:20.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:20:20.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-19T17:20:21.082 INFO:tasks.workunit.client.0.trial119.stderr:noout is set 2026-02-19T17:20:21.095 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-19T17:20:21.388 INFO:tasks.workunit.client.0.trial119.stderr:noin is set 2026-02-19T17:20:21.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-19T17:20:21.693 INFO:tasks.workunit.client.0.trial119.stderr:nodown is set 2026-02-19T17:20:21.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-19T17:20:21.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=test 2026-02-19T17:20:21.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-19T17:20:21.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-19T17:20:21.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-19T17:20:21.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-19T17:20:21.958 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-19T17:20:21.958 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-19T17:20:22.328 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' already exists 2026-02-19T17:20:22.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:20:23.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-19T17:20:23.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-19T17:20:23.645 INFO:tasks.workunit.client.0.trial119.stderr:set pool 1 allow_ec_overwrites to true 2026-02-19T17:20:23.656 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-19T17:20:23.656 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:20:23.656 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:20:23.656 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:20:23.656 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:20:23.657 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:20:23.657 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:20:23.657 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:20:23.657 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:20:23.657 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:20:23.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:20:23.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:20:23.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:20:23.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:20:23.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:20:23.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:20:23.990 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:20:23.990 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:20:23.990 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:20:23.990 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:20:23.990 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:23.990 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:20:24.073 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-19T17:20:24.073 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-19T17:20:24.074 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-19T17:20:24.074 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:24.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:20:24.156 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-19T17:20:24.156 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-19T17:20:24.156 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-19T17:20:24.156 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:24.156 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:20:24.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-19T17:20:24.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-19T17:20:24.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-60129542147' 2026-02-19T17:20:24.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:24.238 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-19T17:20:24.238 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:24.240 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:20:24.241 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-19T17:20:24.241 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:24.242 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-19T17:20:24.242 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-19T17:20:24.242 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836485 2026-02-19T17:20:24.243 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:24.458 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-19T17:20:24.459 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:20:25.459 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:20:25.460 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:25.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-19T17:20:25.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:25.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-19T17:20:25.671 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:25.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:20:25.673 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-19T17:20:25.673 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:25.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-19T17:20:25.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-19T17:20:25.675 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 42949672964 2026-02-19T17:20:25.675 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:20:25.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-19T17:20:25.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:25.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-19T17:20:25.899 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:25.899 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:20:25.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-19T17:20:25.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:25.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-19T17:20:25.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-19T17:20:25.902 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542147 2026-02-19T17:20:25.902 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:20:26.130 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-19T17:20:26.131 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:20:26.131 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:20:26.131 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:20:26.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:20:26.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:20:26.408 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:20:26.408 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:20:26.408 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:20:26.408 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:20:26.409 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:20:26.409 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:20:26.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:20:26.618 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:20:26.619 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:20:26.619 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:20:26.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:20:26.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:20:26.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:20:26.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-19T17:20:26.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-19T17:20:26.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:20:26.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:20:27.109 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:20:27.109 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:20:27.109 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:20:27.109 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:20:27.109 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:27.109 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:20:27.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-19T17:20:27.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-19T17:20:27.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-19T17:20:27.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:27.194 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:20:27.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672967 2026-02-19T17:20:27.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672967 2026-02-19T17:20:27.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672967' 2026-02-19T17:20:27.278 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:27.278 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:20:27.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-19T17:20:27.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-19T17:20:27.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672967 2-60129542150' 2026-02-19T17:20:27.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:27.356 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-19T17:20:27.356 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:27.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:20:27.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-19T17:20:27.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:27.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-19T17:20:27.360 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836487 2026-02-19T17:20:27.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-19T17:20:27.360 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:27.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-19T17:20:27.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:20:28.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:20:28.572 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:28.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-19T17:20:28.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:28.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672967 2026-02-19T17:20:28.789 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:28.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:20:28.791 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672967 2026-02-19T17:20:28.791 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:28.793 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672967 2026-02-19T17:20:28.793 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 42949672967 2026-02-19T17:20:28.793 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672967' 2026-02-19T17:20:28.794 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:20:29.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672967 2026-02-19T17:20:29.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:29.010 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-19T17:20:29.010 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:29.010 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:20:29.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-19T17:20:29.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:29.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-19T17:20:29.013 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542150 2026-02-19T17:20:29.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-19T17:20:29.013 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:20:29.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-19T17:20:29.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-19T17:20:29.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:20:29.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:20:29.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:20:29.225 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:20:29.225 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:20:29.225 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:20:29.226 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:20:29.226 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:20:29.226 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:20:29.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:20:29.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:20:29.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:20:29.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:20:29.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:20:29.330 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:20:29.546 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:20:29.546 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:20:29.546 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:20:29.546 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:20:29.546 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:29.547 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:20:29.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-19T17:20:29.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-19T17:20:29.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-19T17:20:29.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:29.628 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:20:29.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672969 2026-02-19T17:20:29.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672969 2026-02-19T17:20:29.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969' 2026-02-19T17:20:29.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:29.710 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:20:29.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-19T17:20:29.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-19T17:20:29.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969 2-60129542152' 2026-02-19T17:20:29.792 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:29.793 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-19T17:20:29.793 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:29.794 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:20:29.794 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-19T17:20:29.794 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:29.796 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-19T17:20:29.796 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836490 2026-02-19T17:20:29.796 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-19T17:20:29.796 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:30.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-19T17:20:30.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:20:31.014 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:20:31.015 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:31.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-19T17:20:31.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:31.230 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672969 2026-02-19T17:20:31.230 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:31.231 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:20:31.232 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672969 2026-02-19T17:20:31.232 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:31.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672969 2026-02-19T17:20:31.234 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 42949672969 2026-02-19T17:20:31.234 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2026-02-19T17:20:31.234 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:20:31.461 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672969 -lt 42949672969 2026-02-19T17:20:31.461 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:31.461 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-19T17:20:31.462 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:31.463 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:20:31.464 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-19T17:20:31.464 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:31.465 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-19T17:20:31.465 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542152 2026-02-19T17:20:31.465 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-19T17:20:31.465 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:20:31.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542152 2026-02-19T17:20:31.686 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:20:31.687 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:20:31.687 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:20:31.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:20:31.967 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:20:31.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:20:31.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:20:31.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:20:31.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:20:31.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:20:31.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:20:32.176 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:20:32.176 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:20:32.176 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:20:32.176 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:20:32.454 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:20:32.454 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:20:32.454 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:20:32.454 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-19T17:20:32.454 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-19T17:20:32.651 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:20:32.661 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-19T17:20:32.661 INFO:tasks.workunit.client.0.trial119.stdout:primary and soon to be divergent is 1 2026-02-19T17:20:32.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-19T17:20:32.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:20:32.873 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:20:32.874 INFO:tasks.workunit.client.0.trial119.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-19T17:20:22.647561+0000 0'0 28:20 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:54:22.547392+0000 0 0 2026-02-19T17:20:32.874 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:20:32.874 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:20:32.874 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stdout:writing initial objects 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-19T17:20:32.883 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-19T17:20:32.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:32.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:32.908 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:32.908 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:32.937 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:32.937 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:32.963 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:32.963 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:32.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:32.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.014 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.014 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.043 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.043 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.070 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.070 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.119 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.119 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.175 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.175 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.262 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.262 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.291 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.430 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.430 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.458 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.458 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.542 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.542 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.599 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.599 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.653 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.653 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.709 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.766 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.766 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.794 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.794 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.850 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.850 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.878 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.878 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.906 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.906 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.962 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.962 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:33.990 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:33.990 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.065 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.065 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.094 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.122 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.123 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.178 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.178 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.234 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.234 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.262 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.263 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.291 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.317 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.430 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.430 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.458 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.458 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.541 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.595 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.595 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.653 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.653 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.706 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.761 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.761 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.818 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.818 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.846 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.846 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.919 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.919 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.977 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.977 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:34.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.028 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.028 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.075 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.075 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.103 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.130 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.130 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.186 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.186 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.234 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.234 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.259 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.259 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.288 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.288 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.307 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.307 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.366 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.366 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.394 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.395 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.422 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.423 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.450 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.450 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.502 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.502 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.531 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.531 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.559 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-19T17:20:35.588 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:35.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:20:35.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-19T17:20:35.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:20:35.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:20:35.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:20:35.607 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:20:35.608 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:20:35.608 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:20:35.608 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:20:35.608 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:20:35.608 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:20:35.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:20:35.681 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:20:35.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:20:35.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:20:35.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:20:35.682 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:20:35.895 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:20:35.895 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:20:35.895 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:20:35.895 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:20:35.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:35.896 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:20:35.977 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-19T17:20:35.977 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-19T17:20:35.977 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-19T17:20:35.977 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:35.977 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:20:36.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672972 2026-02-19T17:20:36.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672972 2026-02-19T17:20:36.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-42949672972' 2026-02-19T17:20:36.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:20:36.060 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:20:36.143 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-19T17:20:36.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-19T17:20:36.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-60129542156' 2026-02-19T17:20:36.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:36.144 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-19T17:20:36.144 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:36.145 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:20:36.145 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-19T17:20:36.146 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:36.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-19T17:20:36.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-19T17:20:36.147 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 21474836493 2026-02-19T17:20:36.148 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:36.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-19T17:20:36.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:20:37.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:20:37.360 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:20:37.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-19T17:20:37.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:37.578 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672972 2026-02-19T17:20:37.578 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:37.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:20:37.580 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672972 2026-02-19T17:20:37.580 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:37.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672972 2026-02-19T17:20:37.582 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 42949672972 2026-02-19T17:20:37.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2026-02-19T17:20:37.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:20:37.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672972 -lt 42949672972 2026-02-19T17:20:37.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:20:37.806 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542156 2026-02-19T17:20:37.806 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:20:37.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:20:37.808 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-19T17:20:37.808 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:20:37.810 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542156 2026-02-19T17:20:37.810 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 60129542156 2026-02-19T17:20:37.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-19T17:20:37.811 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:20:38.026 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542156 2026-02-19T17:20:38.027 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:20:38.027 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:20:38.027 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:20:38.307 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:20:38.307 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:20:38.307 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:20:38.307 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:20:38.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:20:38.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:20:38.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:20:38.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:20:38.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:20:38.515 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:20:38.516 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:20:38.516 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:20:38.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:20:38.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:20:38.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:20:38.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-19T17:20:38.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-19T17:20:38.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-19T17:20:38.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-19T17:20:38.801 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-19T17:20:39.014 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-19T17:20:39.014 INFO:tasks.workunit.client.0.trial119.stdout:blackholing osds 0 2 2026-02-19T17:20:39.015 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-19T17:20:39.015 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:20:39.218 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:20:39.218 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-19T17:20:22.647561+0000 28'100 28:120 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-20T23:54:22.547392+0000 0 0 2026-02-19T17:20:39.219 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:20:39.219 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:20:39.219 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:20:39.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:39.228 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-19T17:20:39.228 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:20:39.228 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:20:39.228 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:20:39.228 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:39.229 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:39.229 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:20:39.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T17:20:39.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-19T17:20:39.292 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:20:39.292 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:20:39.292 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:20:39.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:39.298 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-19T17:20:39.298 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:20:39.298 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:20:39.298 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:20:39.299 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:39.299 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:39.299 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:20:39.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T17:20:39.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-19T17:20:39.353 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:20:39.353 INFO:tasks.workunit.client.0.trial119.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-19T17:20:39.353 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:20:39.359 INFO:tasks.workunit.client.0.trial119.stdout:writing divergent object 2026-02-19T17:20:39.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-19T17:20:39.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-19T17:20:39.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.jPE6REq3Kn 2026-02-19T17:20:40.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-19T17:20:40.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:40.435 INFO:tasks.workunit.client.0.trial119.stdout:created pool test snap snap1 2026-02-19T17:20:40.437 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-19T17:20:40.438 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-19T17:20:40.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.WrwA8zssKl 2026-02-19T17:20:50.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-19T17:20:50.487 INFO:tasks.workunit.client.0.trial119.stderr:rados: no process found 2026-02-19T17:20:50.487 INFO:tasks.workunit.client.0.trial119.stdout:killing all the osds 2026-02-19T17:20:50.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-19T17:20:50.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:20:50.706 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:20:50.706 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-19T17:20:22.647561+0000 29'104 29:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-20T22:05:18.213725+0000 0 0 2026-02-19T17:20:50.706 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:20:50.707 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:20:50.707 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:20:50.714 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-19T17:20:50.715 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:20:50.716 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:20:50.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:20:50.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:20:50.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:20:51.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:20:51.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:51.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-19T17:20:51.291 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:20:51.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:51.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-19T17:20:51.564 INFO:tasks.workunit.client.0.trial119.stderr:osd.1 is already down. 2026-02-19T17:20:51.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-19T17:20:51.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-19T17:20:51.839 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already down. 2026-02-19T17:20:51.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:51.850 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-19T17:20:52.129 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already out. 2026-02-19T17:20:52.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:52.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-19T17:20:52.408 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already out. 2026-02-19T17:20:52.418 INFO:tasks.workunit.client.0.trial119.stdout:bringing up non_divergent 0 2 2026-02-19T17:20:52.419 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-19T17:20:52.419 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:20:52.632 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:20:52.632 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-19T17:20:22.647561+0000 29'104 29:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-20T22:05:18.213725+0000 0 0 2026-02-19T17:20:52.632 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:20:52.633 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:20:52.633 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:20:52.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:20:52.647 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:20:52.648 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:20:52.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:20:52.649 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:20:52.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:20:52.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:20:52.650 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T17:20:52.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:20:52.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:20:52.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:20:52.650 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:20:52.673 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:52.668+0000 7f9dcfc5aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:52.675 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:52.668+0000 7f9dcfc5aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:52.675 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:52.668+0000 7f9dcfc5aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:52.870 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:20:52.870 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:20:52.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:20:52.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:20:52.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:20:52.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:52.871 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:20:52.872 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:20:52.873 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:52.873 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:20:53.081 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:53.076+0000 7f9dcfc5aa40 -1 Falling back to public interface 2026-02-19T17:20:53.086 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:20:53.774 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:53.768+0000 7f9dcfc5aa40 -1 osd.0 28 log_to_monitors true 2026-02-19T17:20:54.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:20:54.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:54.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:20:54.088 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:20:54.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:54.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:20:54.294 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/3811912746,v1:127.0.0.1:6801/3811912746] [v2:127.0.0.1:6802/3811912746,v1:127.0.0.1:6803/3811912746] exists,up 2b6b831d-9cc0-4674-aa88-afd959b56da2 2026-02-19T17:20:54.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:20:54.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:20:54.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:20:54.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:54.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-19T17:20:54.294 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:20:54.295 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:20:54.296 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:20:54.297 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:20:54.297 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:20:54.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:20:54.298 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T17:20:54.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:20:54.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:20:54.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:20:54.300 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:20:54.324 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:54.320+0000 7f1907bada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:54.326 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:54.320+0000 7f1907bada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:54.327 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:54.320+0000 7f1907bada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:20:54.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:20:54.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:20:54.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:20:54.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:20:54.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:20:54.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:54.516 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:20:54.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:20:54.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:54.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:20:54.732 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:20:54.794 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:54.788+0000 7f1907bada40 -1 Falling back to public interface 2026-02-19T17:20:55.464 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:20:55.460+0000 7f1907bada40 -1 osd.2 28 log_to_monitors true 2026-02-19T17:20:55.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:20:55.734 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:20:55.734 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:20:55.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:20:55.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:20:55.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:20:55.947 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/936904456,v1:127.0.0.1:6811/936904456] [v2:127.0.0.1:6812/936904456,v1:127.0.0.1:6813/936904456] exists,up f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab 2026-02-19T17:20:55.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:20:55.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:20:55.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:20:55.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:55.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-19T17:20:56.192 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already in. 2026-02-19T17:20:56.201 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:20:56.201 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-19T17:20:56.475 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already in. 2026-02-19T17:20:56.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-19T17:21:01.487 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-19T17:21:01.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-19T17:21:01.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-19T17:21:01.489 INFO:tasks.workunit.client.0.trial119.stdout:writing non-divergent object existing_4 2026-02-19T17:21:01.490 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:21:01.688 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:21:01.689 INFO:tasks.workunit.client.0.trial119.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-19T17:20:56.523750+0000 28'100 41:129 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-21T01:05:20.183544+0000 0 0 2026-02-19T17:21:01.689 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:21:01.689 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:21:01.689 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:21:01.697 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.jPE6REq3Kn 2026-02-19T17:21:01.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.jPE6REq3Kn 2026-02-19T17:21:01.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:21:01.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-19T17:21:01.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:21:01.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:21:01.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:21:01.730 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:21:01.731 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:21:01.731 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:21:01.731 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:21:01.731 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:21:01.731 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:21:01.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:21:01.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:21:01.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:21:01.804 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:21:01.804 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:21:01.804 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:21:02.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:21:02.025 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:21:02.025 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:21:02.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:21:02.025 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:21:02.025 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:21:02.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822660 2026-02-19T17:21:02.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822660 2026-02-19T17:21:02.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660' 2026-02-19T17:21:02.107 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:21:02.107 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:21:02.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T17:21:02.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-19T17:21:02.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T17:21:02.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-19T17:21:02.172 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:21:02.172 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:21:02.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757252 2026-02-19T17:21:02.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757252 2026-02-19T17:21:02.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822660 2-163208757252' 2026-02-19T17:21:02.255 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:21:02.255 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822660 2026-02-19T17:21:02.256 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:21:02.256 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:21:02.257 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822660 2026-02-19T17:21:02.257 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:21:02.258 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822660 2026-02-19T17:21:02.258 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 154618822660 2026-02-19T17:21:02.259 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822660' 2026-02-19T17:21:02.259 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:21:02.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822658 -lt 154618822660 2026-02-19T17:21:02.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:21:03.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:21:03.486 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:21:03.702 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-19T17:21:03.703 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:21:03.703 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757252 2026-02-19T17:21:03.703 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:21:03.704 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:21:03.705 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757252 2026-02-19T17:21:03.705 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:21:03.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757252 2026-02-19T17:21:03.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757252' 2026-02-19T17:21:03.707 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 163208757252 2026-02-19T17:21:03.707 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:21:03.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757252 -lt 163208757252 2026-02-19T17:21:03.931 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:21:03.931 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:03.931 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:04.213 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:04.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:04.425 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:04.425 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:04.425 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:04.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:04.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T17:21:04.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T17:21:04.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T17:21:04.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:04.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T17:21:04.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:04.812 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:04.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:04.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:04.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:04.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:04.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:04.813 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:05.021 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:05.022 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:05.022 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:05.023 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:05.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:05.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:05.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:05.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:05.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:05.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:05.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:05.299 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:05.299 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:05.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:05.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:05.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T17:21:05.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:05.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T17:21:05.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:05.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:05.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:05.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:05.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:05.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:05.777 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:05.777 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:05.982 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:05.983 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:05.983 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:05.983 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:06.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:06.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:06.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:06.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:06.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:06.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:06.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:06.267 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:06.267 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:06.544 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:06.545 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:06.545 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T17:21:06.545 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:06.545 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T17:21:06.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:06.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:06.947 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:06.947 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:06.947 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:06.948 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:06.948 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:06.948 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:07.154 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:07.155 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:07.155 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:07.155 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:07.438 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:07.439 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:07.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:07.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:07.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T17:21:07.731 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:07.731 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T17:21:08.531 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:08.532 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:08.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:08.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:08.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:08.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:08.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:08.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:08.740 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:08.741 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:08.741 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:08.741 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:09.024 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:09.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:09.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:09.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T17:21:09.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:09.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T17:21:10.906 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:10.906 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:10.906 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:10.907 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:10.907 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:10.907 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:10.907 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:10.907 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:11.118 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:11.119 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:11.119 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:11.119 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:11.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:11.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:11.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:11.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:11.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:11.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:11.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:11.404 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:11.404 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:11.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:11.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:11.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T17:21:11.689 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:11.689 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T17:21:14.889 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:14.889 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:14.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:14.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:14.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:14.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:14.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:14.890 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:15.099 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:15.099 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:15.099 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:15.099 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:15.394 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:15.394 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:15.684 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:15.684 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:15.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T17:21:15.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:15.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T17:21:22.085 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:22.086 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:22.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:22.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:22.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:22.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:22.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:22.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:22.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:22.305 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:22.305 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:22.305 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:22.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:22.584 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:22.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:22.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:22.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T17:21:22.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:22.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T17:21:30.163 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:30.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:30.164 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:30.165 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:30.165 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:30.165 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:30.165 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:30.165 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:30.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:30.373 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:30.374 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:30.374 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:30.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:30.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:30.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:30.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:30.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:30.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:30.654 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:30.655 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:30.655 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:30.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:30.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:30.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T17:21:30.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T17:21:31.222 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_fingerprint": "12a5a5d2-9333-4b23-a67c-9ad6b4d75091", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "version": "20.3.0-5336-g802bf111", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "commit": "802bf111cd55e57f5842153d7ba2b8b964aa818a", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "timestamp": "2026-02-19T17:21:31.218794+0000", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "tag": "", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "health": { 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "status": "HEALTH_WARN", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "checks": { 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "OSDMAP_FLAGS": { 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T17:21:31.223 INFO:tasks.workunit.client.0.trial119.stdout: "count": 17 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [], 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "OSD_DOWN": { 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "message": "1 osds down", 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.224 INFO:tasks.workunit.client.0.trial119.stdout: "message": "osd.1 (root=default,host=trial119) is down" 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "PG_DEGRADED": { 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-19T17:21:31.225 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "mutes": [] 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_first_committed": 1, 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_last_committed": 1, 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "monmap": { 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:20:09.944924Z", 2026-02-19T17:21:31.226 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:20:09.944924Z", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release": 20, 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release_name": "tentacle", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "election_strategy": 1, 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "disallowed_leaders": "", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": false, 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "tiebreaker_mon": "", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "removed_ranks": "", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "features": { 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "persistent": [ 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "kraken", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "luminous", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "mimic", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap-prune", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "nautilus", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "octopus", 2026-02-19T17:21:31.227 INFO:tasks.workunit.client.0.trial119.stdout: "pacific", 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "elector-pinging", 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "quincy", 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "reef", 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "squid", 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "tentacle", 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "nvmeof_beacon_diff" 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "optional": [] 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "mons": [ 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "rank": 0, 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "name": "a", 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:21:31.228 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115", 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 0 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "priority": 0, 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 0, 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "time_added": "2026-02-19T17:20:09:944922+0000", 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: "crush_location": [] 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.229 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "quorum": [ 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: 0 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap": { 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 41, 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:20:10.026680+0000", 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:20:56.519861+0000", 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "last_up_change": "2026-02-19T17:20:55.616991+0000", 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "last_in_change": "2026-02-19T17:20:56.416553+0000", 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "flags_num": 5800384, 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "flags_set": [ 2026-02-19T17:21:31.230 INFO:tasks.workunit.client.0.trial119.stdout: "nodown", 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "noin", 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "noout", 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "pglog_hardlimit", 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snapdirs", 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "recovery_deletes", 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "sortbitwise" 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "crush_version": 10, 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_snapshot": "", 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "pool_max": 1, 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "max_osd": 3, 2026-02-19T17:21:31.231 INFO:tasks.workunit.client.0.trial119.stdout: "require_min_compat_client": "luminous", 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "min_compat_client": "jewel", 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "require_osd_release": "tentacle", 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "allow_crimson": false, 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "pools": [ 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "pool_name": "test", 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "create_time": "2026-02-19T17:20:22.184069+0000", 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "flags": 16389, 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "type": 3, 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "size": 3, 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "min_size": 2, 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "crush_rule": 1, 2026-02-19T17:21:31.232 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_count": 0, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_target": 0, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "is_stretch_pool": false, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "object_hash": 2, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "pg_autoscale_mode": "off", 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num": 1, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num": 1, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num_target": 1, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_target": 1, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_pending": 1, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "last_pg_merge_meta": { 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "source_pgid": "0.0", 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "ready_epoch": 0, 2026-02-19T17:21:31.233 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_started": 0, 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": 0, 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "source_version": "0'0", 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "target_version": "0'0" 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "last_change": "29", 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend": "0", 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "auid": 0, 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "snap_mode": "pool", 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "snap_seq": 1, 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "snap_epoch": 29, 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "pool_snaps": [ 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.234 INFO:tasks.workunit.client.0.trial119.stdout: "snapid": 1, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "stamp": "2026-02-19T17:20:40.380459+0000", 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "name": "snap1" 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps": "[]", 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_bytes": 0, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_objects": 0, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "tiers": [], 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "tier_of": -1, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "read_tier": -1, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "write_tier": -1, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "cache_mode": "none", 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_bytes": 0, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_objects": 0, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T17:21:31.235 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_flush_age": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_evict_age": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profile": "myprofile", 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_params": { 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "type": "none" 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_period": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_count": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "use_gmt_hitset": true, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "min_read_recency_for_promote": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "min_write_recency_for_promote": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_search_last_n": 0, 2026-02-19T17:21:31.236 INFO:tasks.workunit.client.0.trial119.stdout: "grade_table": [], 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "stripe_width": 8192, 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "expected_num_objects": 0, 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "fast_read": false, 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "nonprimary_shards": "{}", 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "options": {}, 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "application_metadata": {} 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "osds": [ 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "2b6b831d-9cc0-4674-aa88-afd959b56da2", 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:21:31.237 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 5, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 36, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 40, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 30, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6800", 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.238 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6801", 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6802", 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.239 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6803", 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6806", 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.240 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6807", 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6804", 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6805", 2026-02-19T17:21:31.241 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 3811912746 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6801/3811912746", 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6803/3811912746", 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3811912746", 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3811912746", 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:21:31.242 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "cbf446a6-b895-4ce0-a417-62785f1f4f57", 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "up": 0, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 0, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 0, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 10, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 24, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 31, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:21:31.243 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.244 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.245 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:21:31.246 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/314207968", 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/314207968", 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/314207968", 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/314207968", 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: "exists" 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.247 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab", 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 14, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 28, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 38, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 0, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 32, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.248 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.249 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.250 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:21:31.251 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 936904456 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/936904456", 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/936904456", 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/936904456", 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/936904456", 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "osd_xinfo": [ 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.252 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:20:51.233119+0000", 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:20:13.739356+0000", 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:20:51.506572+0000", 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:21:31.253 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:20:51.781207+0000", 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:20:20.030049+0000", 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.254 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap": [], 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_items": [], 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_primaries": [], 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "pg_temp": [], 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "primary_temp": [], 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "blocklist": {}, 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "range_blocklist": {}, 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profiles": { 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "default": { 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "m": "2", 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "myprofile": { 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "crush-device-class": "", 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "crush-failure-domain": "osd", 2026-02-19T17:21:31.255 INFO:tasks.workunit.client.0.trial119.stdout: "crush-num-failure-domains": "0", 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "crush-osds-per-failure-domain": "0", 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "crush-root": "default", 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "m": "1", 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps_queue": [], 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "new_removed_snaps": [], 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "new_purged_snaps": [], 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "crush_node_flags": {}, 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "device_class_flags": {}, 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": { 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_enabled": false, 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_bucket_count": 0, 2026-02-19T17:21:31.256 INFO:tasks.workunit.client.0.trial119.stdout: "degraded_stretch_mode": 0, 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "recovering_stretch_mode": 0, 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_bucket": 0 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "osd_metadata": [ 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6802/3811912746,v1:127.0.0.1:6803/3811912746]", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:21:31.257 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:21:31.258 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:20:11.005586Z", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6800/3811912746,v1:127.0.0.1:6801/3811912746]", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3811912746,v1:127.0.0.1:6807/3811912746]", 2026-02-19T17:21:31.259 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3811912746,v1:127.0.0.1:6805/3811912746]", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:21:31.260 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/314207968,v1:127.0.0.1:6813/314207968]", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:21:31.261 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:20:14.624817Z", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/314207968,v1:127.0.0.1:6811/314207968]", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/314207968,v1:127.0.0.1:6817/314207968]", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/314207968,v1:127.0.0.1:6815/314207968]", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:21:31.262 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/936904456,v1:127.0.0.1:6813/936904456]", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:21:31.263 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:21:31.264 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:20:17.516919Z", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/936904456,v1:127.0.0.1:6811/936904456]", 2026-02-19T17:21:31.265 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/936904456,v1:127.0.0.1:6817/936904456]", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/936904456,v1:127.0.0.1:6815/936904456]", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.266 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_clean_epochs": { 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "min_last_epoch_clean": 0, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": { 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "per_pool": [] 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "osd_epochs": [ 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 36 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 40 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_first_committed": 1, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_last_committed": 41, 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "crushmap": { 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: "devices": [ 2026-02-19T17:21:31.267 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.0", 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.1", 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.2", 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: "types": [ 2026-02-19T17:21:31.268 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 0, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd" 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "name": "host" 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 2, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "name": "chassis" 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 3, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "name": "rack" 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 4, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "name": "row" 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 5, 2026-02-19T17:21:31.269 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pdu" 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 6, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pod" 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 7, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "name": "room" 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 8, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "name": "datacenter" 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 9, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "name": "zone" 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 10, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "name": "region" 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.270 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "name": "root" 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "buckets": [ 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "id": -1, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default", 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "id": -2, 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default~ssd", 2026-02-19T17:21:31.271 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119", 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:21:31.272 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119~ssd", 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:21:31.273 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "rules": [ 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 0, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "replicated_rule", 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:21:31.274 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_firstn", 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 1, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "test", 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "type": 3, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "op": "set_chooseleaf_tries", 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: "num": 5 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.275 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stderr:report 1001146517 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "op": "set_choose_tries", 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "num": 100 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_indep", 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:21:31.276 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "tunables": { 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_tries": 0, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_fallback_tries": 0, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "choose_total_tries": 50, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_descend_once": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_vary_r": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_stable": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "msr_descents": 100, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "msr_collision_tries": 100, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "straw_calc_version": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "allowed_bucket_algs": 54, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "profile": "jewel", 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_tunables": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "legacy_tunables": 0, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "minimum_required_version": "jewel", 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables2": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "has_v2_rules": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables3": 1, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "has_v3_rules": 0, 2026-02-19T17:21:31.277 INFO:tasks.workunit.client.0.trial119.stdout: "has_v4_buckets": 1, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables5": 1, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "has_v5_rules": 0, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "has_msr_rules": 0 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "choose_args": {} 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "fsmap": { 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "btime": "2026-02-19T17:20:10:026494+0000", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "default_fscid": -1, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "compat": { 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "compat": {}, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "ro_compat": {}, 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "incompat": { 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_1": "base v0.20", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_2": "client writeable ranges", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_4": "dir inode in separate object", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_8": "no anchor table", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_9": "file layout v2", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_10": "snaprealm v2", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_11": "minor log segments", 2026-02-19T17:21:31.278 INFO:tasks.workunit.client.0.trial119.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "feature_flags": { 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "enable_multiple": true, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "ever_enabled_multiple": true 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "standbys": [], 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "filesystems": [] 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_first_committed": 1, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_last_committed": 1, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "auth": { 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 5, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_secrets": 3 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_active": 1, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_unknown": 0, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_osd": 3, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "pool_sum": { 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 52200, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 101, 2026-02-19T17:21:31.279 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 1, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 303, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 101, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 101, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:21:31.280 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 18, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 18, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "up": 3, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 3, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 0 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum": { 2026-02-19T17:21:31.281 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83900, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2124, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 25, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81702, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488900, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036633600, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2174976, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 1534810, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 25764, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83663708 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:21:31.282 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum_by_class": { 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "ssd": { 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 83900, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2124, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 25, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 81702, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314488900, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322036633600, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2174976, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 1534810, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:21:31.283 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 25764, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 83663708 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "pool_stats": [ 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 52200, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 101, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 1, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 303, 2026-02-19T17:21:31.284 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 101, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 101, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:21:31.285 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 1241088, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 1241088, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 18, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 18, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "up": 3, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 3, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 3 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "osd_stats": [ 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 154618822666 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:21:31.286 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 42949672975 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 163208757257 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_state": [ 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded", 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num": 1 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "pool_pg_unavailable_map": [ 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": "1", 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "pgs": [] 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_osd": [ 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2147483647, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.287 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 1, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 0, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": [ 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": {} 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "servicemap": { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 3, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:21:18.470401+0000", 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "services": { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "osd": { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "daemons": { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "summary": "", 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "0": { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "2": { 2026-02-19T17:21:31.288 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_first_committed": 1, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_last_committed": 41, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "logm_first_committed": 1, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "logm_last_committed": 227, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "paxos": { 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 319, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "last_pn": 0, 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: "accepted_pn": 0 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:21:31.289 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:21:31.290 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-19T17:21:31.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-19T17:21:31.518 INFO:tasks.workunit.client.0.trial119.stderr:PG '1.0' not found 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:21:31.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:21:31.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-19T17:21:31.619 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:21:31.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:21:31.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:21:31.620 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-19T17:21:31.621 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:21:31.621 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:21:31.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:21:31.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:21:31.643 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:31.636+0000 7f57723ada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:21:31.644 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:31.636+0000 7f57723ada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:21:31.645 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:31.640+0000 7f57723ada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:21:31.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:21:32.018 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:32.012+0000 7f57723ada40 -1 Falling back to public interface 2026-02-19T17:21:32.054 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 36 up_thru 40 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/3811912746,v1:127.0.0.1:6801/3811912746] [v2:127.0.0.1:6802/3811912746,v1:127.0.0.1:6803/3811912746] exists,up 2b6b831d-9cc0-4674-aa88-afd959b56da2 2026-02-19T17:21:32.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:21:32.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:21:32.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:21:32.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:21:32.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-19T17:21:32.055 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:21:32.055 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:21:32.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:21:32.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:21:32.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:21:32.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:21:32.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-19T17:21:32.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T17:21:32.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T17:21:32.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-19T17:21:32.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T17:21:32.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-19T17:21:32.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-19T17:21:32.372 INFO:tasks.workunit.client.0.trial119.stderr:PG '1.0' not found 2026-02-19T17:21:32.483 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-19T17:21:32.483 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-19T17:21:32.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:21:32.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:21:32.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-19T17:21:32.487 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:21:32.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:21:32.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:21:32.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-19T17:21:32.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:21:32.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:21:32.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:21:32.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:21:32.505 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:32.500+0000 7f0d89b12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:21:32.507 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:32.500+0000 7f0d89b12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:21:32.507 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:32.500+0000 7f0d89b12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:21:32.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:21:32.921 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/936904456,v1:127.0.0.1:6811/936904456] [v2:127.0.0.1:6812/936904456,v1:127.0.0.1:6813/936904456] exists,up f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-19T17:21:32.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-19T17:21:32.923 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:32.916+0000 7f57723ada40 -1 osd.0 41 log_to_monitors true 2026-02-19T17:21:32.966 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:32.960+0000 7f0d89b12a40 -1 Falling back to public interface 2026-02-19T17:21:33.142 INFO:tasks.workunit.client.0.trial119.stderr:PG '1.0' not found 2026-02-19T17:21:33.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-19T17:21:33.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-19T17:21:33.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-19T17:21:33.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:21:33.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:21:33.245 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:21:33.245 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-19T17:21:33.246 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:21:33.246 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:21:33.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:21:33.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:21:33.246 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:21:33.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-19T17:21:33.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:21:33.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:21:33.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:21:33.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:21:33.308 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:21:33.531 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:21:33.531 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:21:33.531 INFO:tasks.workunit.client.0.trial119.stderr:2' 2026-02-19T17:21:33.532 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:21:33.532 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:21:33.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:21:33.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561027 2026-02-19T17:21:33.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561027 2026-02-19T17:21:33.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561027' 2026-02-19T17:21:33.617 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:21:33.617 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:21:33.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-19T17:21:33.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-19T17:21:33.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-19T17:21:33.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-19T17:21:33.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:21:33.680 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:21:33.831 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:21:33.824+0000 7f0d89b12a40 -1 osd.2 41 log_to_monitors true 2026-02-19T17:21:38.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=206158430211 2026-02-19T17:21:38.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 206158430211 2026-02-19T17:21:38.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561027 2-206158430211' 2026-02-19T17:21:38.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:21:38.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-188978561027 2026-02-19T17:21:38.775 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:21:38.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:21:38.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-188978561027 2026-02-19T17:21:38.776 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:21:38.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561027 2026-02-19T17:21:38.778 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 188978561027 2026-02-19T17:21:38.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 188978561027' 2026-02-19T17:21:38.778 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:21:38.995 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561028 -lt 188978561027 2026-02-19T17:21:38.996 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:21:38.996 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-206158430211 2026-02-19T17:21:38.996 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:21:38.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:21:38.998 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-206158430211 2026-02-19T17:21:38.998 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:21:39.000 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=206158430211 2026-02-19T17:21:39.000 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 206158430211' 2026-02-19T17:21:39.000 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 206158430211 2026-02-19T17:21:39.000 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:21:39.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 206158430211 2026-02-19T17:21:39.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:21:40.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:21:40.224 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:21:40.441 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 206158430211 2026-02-19T17:21:40.442 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:21:41.443 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T17:21:41.443 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:21:41.653 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 206158430212 -lt 206158430211 2026-02-19T17:21:41.653 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:21:41.654 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:41.654 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:41.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:21:41.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:41.934 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:41.934 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:41.934 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:41.934 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:41.935 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:41.935 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:42.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:42.142 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:42.142 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:42.142 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:42.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:42.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-19T17:21:42.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-19T17:21:42.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-19T17:21:42.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:42.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-19T17:21:42.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:42.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:42.526 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:42.526 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:42.526 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:42.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:42.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:42.527 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:42.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:42.736 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:42.736 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:42.736 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:43.016 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:43.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:43.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:43.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-19T17:21:43.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:43.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-19T17:21:43.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:43.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:43.512 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:43.513 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:43.513 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:43.513 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:43.513 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:43.513 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:43.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:43.723 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:43.723 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:43.723 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:44.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:44.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:44.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:44.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:44.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:44.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:44.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:44.013 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:44.013 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:44.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:44.298 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:44.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-19T17:21:44.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:44.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-19T17:21:44.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:44.700 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:44.701 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:44.701 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:44.701 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:44.701 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:44.702 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:44.702 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:44.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:44.914 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:44.914 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:44.914 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:45.190 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:45.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:45.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:45.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-19T17:21:45.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:45.477 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-19T17:21:46.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:46.277 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:46.278 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:46.278 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:46.278 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:46.278 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:46.279 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:46.279 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:46.494 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:46.495 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:46.495 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:46.495 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:46.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:46.780 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:47.066 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:47.066 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:47.066 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-19T17:21:47.066 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:47.066 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-19T17:21:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:48.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:48.667 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:48.667 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:48.667 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:48.667 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:48.668 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:48.668 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:48.880 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:48.881 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:48.881 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:48.881 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:49.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:49.165 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:49.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:49.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:49.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-19T17:21:49.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:49.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-19T17:21:52.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:52.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:52.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:52.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:52.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:52.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:52.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:52.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:21:52.858 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:21:52.859 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:21:52.859 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:21:52.859 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:21:53.142 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:21:53.143 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:21:53.427 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:21:53.428 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:21:53.428 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-19T17:21:53.428 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:21:53.428 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-19T17:21:59.828 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:21:59.829 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:21:59.829 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:21:59.829 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:21:59.829 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:21:59.829 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:21:59.830 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:21:59.830 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:22:00.044 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:22:00.044 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:22:00.045 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:22:00.045 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:22:00.325 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:22:00.326 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:22:00.607 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:22:00.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:22:00.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-19T17:22:00.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-19T17:22:00.608 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-19T17:22:07.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-19T17:22:07.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:22:07.910 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:22:07.910 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:22:07.910 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:22:07.910 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:22:07.910 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:22:07.910 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:22:08.124 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-19T17:22:08.124 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:22:08.125 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:22:08.125 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:22:08.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-19T17:22:08.411 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-19T17:22:08.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-19T17:22:08.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-19T17:22:08.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-19T17:22:08.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-19T17:22:08.966 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:22:08.966 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_fingerprint": "12a5a5d2-9333-4b23-a67c-9ad6b4d75091", 2026-02-19T17:22:08.966 INFO:tasks.workunit.client.0.trial119.stdout: "version": "20.3.0-5336-g802bf111", 2026-02-19T17:22:08.966 INFO:tasks.workunit.client.0.trial119.stdout: "commit": "802bf111cd55e57f5842153d7ba2b8b964aa818a", 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "timestamp": "2026-02-19T17:22:08.961638+0000", 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "tag": "", 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "health": { 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "status": "HEALTH_WARN", 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "checks": { 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "OSDMAP_FLAGS": { 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "count": 17 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.967 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [], 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: "OSD_DOWN": { 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: "message": "1 osds down", 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.968 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: "message": "osd.1 (root=default,host=trial119) is down" 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: "PG_DEGRADED": { 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: "severity": "HEALTH_WARN", 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: "summary": { 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: "count": 1 2026-02-19T17:22:08.969 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: "detail": [ 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: "muted": false 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: "mutes": [] 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.970 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_first_committed": 1, 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "monmap_last_committed": 1, 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "monmap": { 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:20:09.944924Z", 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:20:09.944924Z", 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release": 20, 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "min_mon_release_name": "tentacle", 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "election_strategy": 1, 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "disallowed_leaders": "", 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": false, 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "tiebreaker_mon": "", 2026-02-19T17:22:08.971 INFO:tasks.workunit.client.0.trial119.stdout: "removed_ranks": "", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "features": { 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "persistent": [ 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "kraken", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "luminous", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "mimic", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap-prune", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "nautilus", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "octopus", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "pacific", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "elector-pinging", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "quincy", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "reef", 2026-02-19T17:22:08.972 INFO:tasks.workunit.client.0.trial119.stdout: "squid", 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "tentacle", 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "nvmeof_beacon_diff" 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "optional": [] 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "mons": [ 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "rank": 0, 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "name": "a", 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.973 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115", 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 0 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:7115/0", 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "priority": 0, 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 0, 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "time_added": "2026-02-19T17:20:09:944922+0000", 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: "crush_location": [] 2026-02-19T17:22:08.974 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "quorum": [ 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: 0 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap": { 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 49, 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "fsid": "4807f673-6eb2-4592-bb90-c84d4f1124e4", 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "created": "2026-02-19T17:20:10.026680+0000", 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:21:34.186941+0000", 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "last_up_change": "2026-02-19T17:21:34.084379+0000", 2026-02-19T17:22:08.975 INFO:tasks.workunit.client.0.trial119.stdout: "last_in_change": "2026-02-19T17:20:56.416553+0000", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "flags_num": 5800384, 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "flags_set": [ 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "nodown", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "noin", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "noout", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "pglog_hardlimit", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snapdirs", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "recovery_deletes", 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "sortbitwise" 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "crush_version": 12, 2026-02-19T17:22:08.976 INFO:tasks.workunit.client.0.trial119.stdout: "full_ratio": 0.99000000953674316, 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_snapshot": "", 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "pool_max": 1, 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "max_osd": 3, 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "require_min_compat_client": "luminous", 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "min_compat_client": "jewel", 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "require_osd_release": "tentacle", 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "allow_crimson": false, 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "pools": [ 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:22:08.977 INFO:tasks.workunit.client.0.trial119.stdout: "pool_name": "test", 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "create_time": "2026-02-19T17:20:22.184069+0000", 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "flags": 16389, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "type": 3, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "size": 3, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "min_size": 2, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "crush_rule": 1, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_count": 0, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_target": 0, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_barrier": 0, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-19T17:22:08.978 INFO:tasks.workunit.client.0.trial119.stdout: "is_stretch_pool": false, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "object_hash": 2, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "pg_autoscale_mode": "off", 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num": 1, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num": 1, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "pg_placement_num_target": 1, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_target": 1, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "pg_num_pending": 1, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "last_pg_merge_meta": { 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "source_pgid": "0.0", 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "ready_epoch": 0, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_started": 0, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": 0, 2026-02-19T17:22:08.979 INFO:tasks.workunit.client.0.trial119.stdout: "source_version": "0'0", 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "target_version": "0'0" 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "last_change": "29", 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend": "0", 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "last_force_op_resend_preluminous": "0", 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "auid": 0, 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "snap_mode": "pool", 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "snap_seq": 1, 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "snap_epoch": 29, 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "pool_snaps": [ 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.980 INFO:tasks.workunit.client.0.trial119.stdout: "snapid": 1, 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "stamp": "2026-02-19T17:20:40.380459+0000", 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "name": "snap1" 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps": "[]", 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_bytes": 0, 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "quota_max_objects": 0, 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "tiers": [], 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "tier_of": -1, 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "read_tier": -1, 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "write_tier": -1, 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "cache_mode": "none", 2026-02-19T17:22:08.981 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_bytes": 0, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "target_max_objects": 0, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_flush_age": 0, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "cache_min_evict_age": 0, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profile": "myprofile", 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_params": { 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "type": "none" 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_period": 0, 2026-02-19T17:22:08.982 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_count": 0, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "use_gmt_hitset": true, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "min_read_recency_for_promote": 0, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "min_write_recency_for_promote": 0, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_grade_decay_rate": 0, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "hit_set_search_last_n": 0, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "grade_table": [], 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "stripe_width": 8192, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "expected_num_objects": 0, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "fast_read": false, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "nonprimary_shards": "{}", 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "options": {}, 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: "application_metadata": {} 2026-02-19T17:22:08.983 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "osds": [ 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "2b6b831d-9cc0-4674-aa88-afd959b56da2", 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 36, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 41, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 44, 2026-02-19T17:22:08.984 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 48, 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 43, 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6800", 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.985 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6801", 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6802", 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.986 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6803", 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6806", 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.987 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6807", 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6804", 2026-02-19T17:22:08.988 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6805", 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 1341520464 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6801/1341520464", 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6803/1341520464", 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6807/1341520464", 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6805/1341520464", 2026-02-19T17:22:08.989 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "cbf446a6-b895-4ce0-a417-62785f1f4f57", 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "up": 0, 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 0, 2026-02-19T17:22:08.990 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 0, 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 10, 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 24, 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 31, 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.991 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.992 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.993 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.994 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 314207968 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/314207968", 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/314207968", 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/314207968", 2026-02-19T17:22:08.995 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/314207968", 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "exists" 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "uuid": "f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab", 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "up": 1, 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "in": 1, 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 1, 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "primary_affinity": 1, 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_begin": 38, 2026-02-19T17:22:08.996 INFO:tasks.workunit.client.0.trial119.stdout: "last_clean_end": 41, 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 48, 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "up_thru": 0, 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "down_at": 47, 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "lost_at": 0, 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "public_addrs": { 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6810", 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.997 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6811", 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addrs": { 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6812", 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.998 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6813", 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addrs": { 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6816", 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:08.999 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6817", 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addrs": { 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "addrvec": [ 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v2", 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6814", 2026-02-19T17:22:09.000 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "type": "v1", 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "127.0.0.1:6815", 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "nonce": 933672420 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "public_addr": "127.0.0.1:6811/933672420", 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "cluster_addr": "127.0.0.1:6813/933672420", 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_back_addr": "127.0.0.1:6817/933672420", 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "heartbeat_front_addr": "127.0.0.1:6815/933672420", 2026-02-19T17:22:09.001 INFO:tasks.workunit.client.0.trial119.stdout: "state": [ 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "exists", 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "up" 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "osd_xinfo": [ 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:21:33.109484+0000", 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:22:09.002 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:20:13.739356+0000", 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:20:51.506572+0000", 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.003 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "down_stamp": "2026-02-19T17:21:33.983691+0000", 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_probability": 0, 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "laggy_interval": 0, 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "features": 4544132024016699391, 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "old_weight": 0, 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "last_purged_snaps_scrub": "2026-02-19T17:20:20.030049+0000", 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "dead_epoch": 0 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap": [], 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_items": [], 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "pg_upmap_primaries": [], 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "pg_temp": [], 2026-02-19T17:22:09.004 INFO:tasks.workunit.client.0.trial119.stdout: "primary_temp": [], 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "blocklist": {}, 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "range_blocklist": {}, 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "erasure_code_profiles": { 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "default": { 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "m": "2", 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "myprofile": { 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "crush-device-class": "", 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "crush-failure-domain": "osd", 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "crush-num-failure-domains": "0", 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "crush-osds-per-failure-domain": "0", 2026-02-19T17:22:09.005 INFO:tasks.workunit.client.0.trial119.stdout: "crush-root": "default", 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "k": "2", 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "m": "1", 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "plugin": "isa", 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "technique": "reed_sol_van" 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "removed_snaps_queue": [], 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "new_removed_snaps": [], 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "new_purged_snaps": [], 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "crush_node_flags": {}, 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "device_class_flags": {}, 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode": { 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_enabled": false, 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_bucket_count": 0, 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "degraded_stretch_mode": 0, 2026-02-19T17:22:09.006 INFO:tasks.workunit.client.0.trial119.stdout: "recovering_stretch_mode": 0, 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "stretch_mode_bucket": 0 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "osd_metadata": [ 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6802/1341520464,v1:127.0.0.1:6803/1341520464]", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:22:09.007 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:22:09.008 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:20:11.005586Z", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6800/1341520464,v1:127.0.0.1:6801/1341520464]", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/1341520464,v1:127.0.0.1:6807/1341520464]", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/1341520464,v1:127.0.0.1:6805/1341520464]", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:22:09.009 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/0", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/314207968,v1:127.0.0.1:6813/314207968]", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:22:09.010 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:22:09.011 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:20:14.624817Z", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/314207968,v1:127.0.0.1:6811/314207968]", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/314207968,v1:127.0.0.1:6817/314207968]", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/314207968,v1:127.0.0.1:6815/314207968]", 2026-02-19T17:22:09.012 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/1", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "arch": "x86_64", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "back_addr": "[v2:127.0.0.1:6812/933672420,v1:127.0.0.1:6813/933672420]", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "back_iface": "", 2026-02-19T17:22:09.013 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs": "1", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_db": "0", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_dedicated_wal": "0", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluefs_single_shared_device": "1", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocation_from_file": "1", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_allocator": "hybrid", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_access_mode": "file", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_block_size": "4096", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_rotational": "0", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_size": "107374182400", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_support_discard": "1", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_bdev_type": "ssd", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_db_sharding": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_min_alloc_size": "4096", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-19T17:22:09.014 INFO:tasks.workunit.client.0.trial119.stdout: "bluestore_write_mode": "classic", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_release": "tentacle", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_short": "20.3.0-5336-g802bf111", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "ceph_version_when_created": "ceph version 20.3.0-5336-g802bf111 (802bf111cd55e57f5842153d7ba2b8b964aa818a) tentacle (dev - None)", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "created_at": "2026-02-19T17:20:17.516919Z", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "default_device_class": "ssd", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD471E", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "devices": "nvme0n1", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "distro": "ubuntu", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "distro_version": "22.04", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "front_addr": "[v2:127.0.0.1:6810/933672420,v1:127.0.0.1:6811/933672420]", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "front_iface": "", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/933672420,v1:127.0.0.1:6817/933672420]", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/933672420,v1:127.0.0.1:6815/933672420]", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "hostname": "trial119", 2026-02-19T17:22:09.015 INFO:tasks.workunit.client.0.trial119.stdout: "journal_rotational": "0", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "mem_swap_kb": "8388604", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "mem_total_kb": "130961696", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_node": "0", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "objectstore_numa_nodes": "0", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "os": "Linux", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "osd_data": "td/divergent-priors/2", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "osd_objectstore": "bluestore", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "osdspec_affinity": "", 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "rotational": "0" 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_clean_epochs": { 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "min_last_epoch_clean": 25, 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "last_epoch_clean": { 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "per_pool": [ 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: "floor": 25 2026-02-19T17:22:09.016 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "osd_epochs": [ 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 45 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 49 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_first_committed": 1, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "osdmap_last_committed": 49, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "crushmap": { 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "devices": [ 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:22:09.017 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.0", 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.1", 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd.2", 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "class": "ssd" 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "types": [ 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 0, 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "name": "osd" 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: "name": "host" 2026-02-19T17:22:09.018 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 2, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "name": "chassis" 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 3, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "name": "rack" 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 4, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "name": "row" 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 5, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pdu" 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 6, 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: "name": "pod" 2026-02-19T17:22:09.019 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 7, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "name": "room" 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 8, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "name": "datacenter" 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 9, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "name": "zone" 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 10, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "name": "region" 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "name": "root" 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.020 INFO:tasks.workunit.client.0.trial119.stdout: "buckets": [ 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "id": -1, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default", 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "id": -2, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "name": "default~ssd", 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 11, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "root", 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:22:09.021 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "id": -3, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119", 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.022 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "id": -4, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "name": "trial119~ssd", 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "type_id": 1, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "type_name": "host", 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 19206, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "alg": "straw2", 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "hash": "rjenkins1", 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "items": [ 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "id": 0, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:22:09.023 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 0 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "id": 1, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 1 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "id": 2, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "weight": 6402, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "pos": 2 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "rules": [ 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 0, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "replicated_rule", 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "type": 1, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.024 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_firstn", 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "rule_id": 1, 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "rule_name": "test", 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "type": 3, 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "steps": [ 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stdout: "op": "set_chooseleaf_tries", 2026-02-19T17:22:09.025 INFO:tasks.workunit.client.0.trial119.stderr:report 937998559 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "num": 5 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "op": "set_choose_tries", 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "num": 100 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "op": "take", 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "item": -1, 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "item_name": "default" 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "op": "choose_indep", 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "num": 0, 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "type": "osd" 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.026 INFO:tasks.workunit.client.0.trial119.stdout: "op": "emit" 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: ] 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "tunables": { 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_tries": 0, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "choose_local_fallback_tries": 0, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "choose_total_tries": 50, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_descend_once": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_vary_r": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "chooseleaf_stable": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "msr_descents": 100, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "msr_collision_tries": 100, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "straw_calc_version": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "allowed_bucket_algs": 54, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "profile": "jewel", 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "optimal_tunables": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "legacy_tunables": 0, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "minimum_required_version": "jewel", 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables2": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "has_v2_rules": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables3": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "has_v3_rules": 0, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "has_v4_buckets": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "require_feature_tunables5": 1, 2026-02-19T17:22:09.027 INFO:tasks.workunit.client.0.trial119.stdout: "has_v5_rules": 0, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "has_msr_rules": 0 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "choose_args": {} 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "fsmap": { 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 1, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "btime": "2026-02-19T17:20:10:026494+0000", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "default_fscid": -1, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "compat": { 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "compat": {}, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "ro_compat": {}, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "incompat": { 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_1": "base v0.20", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_2": "client writeable ranges", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_3": "default file layouts on dirs", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_4": "dir inode in separate object", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_5": "mds uses versioned encoding", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_8": "no anchor table", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_9": "file layout v2", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_10": "snaprealm v2", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_11": "minor log segments", 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_12": "quiesce subvolumes" 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "feature_flags": { 2026-02-19T17:22:09.028 INFO:tasks.workunit.client.0.trial119.stdout: "enable_multiple": true, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "ever_enabled_multiple": true 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "standbys": [], 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "filesystems": [] 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_first_committed": 1, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "mdsmap_last_committed": 1, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "auth": { 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 5, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_secrets": 3 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_active": 1, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_unknown": 0, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_osd": 3, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "pool_sum": { 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 52200, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 101, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 1, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 303, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 101, 2026-02-19T17:22:09.029 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 101, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:22:09.030 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 18, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 18, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "up": 3, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 3, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 0 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum": { 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:22:09.031 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 85052, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2252, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 30, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 82721, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314487748, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322035453952, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2306048, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 1588750, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 30951, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 84707097 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:22:09.032 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "osd_sum_by_class": { 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "ssd": { 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "up_from": 0, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 0, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "num_pgs": 3, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "num_osds": 3, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_osds": 3, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "num_per_pool_omap_osds": 3, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "kb": 314572800, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used": 85052, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_data": 2252, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_omap": 30, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "kb_used_meta": 82721, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "kb_avail": 314487748, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "statfs": { 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "total": 322122547200, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "available": 322035453952, 2026-02-19T17:22:09.033 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 2306048, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 1588750, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 30951, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 84707097 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "hb_peers": [], 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "snap_trim_queue_len": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "num_snap_trimming": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "num_shards_repaired": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "op_queue_age_hist": { 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "histogram": [], 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "upper_bound": 1 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "perf_stat": { 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ms": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ms": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "commit_latency_ns": 0, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "apply_latency_ns": 0 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "alerts": [], 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "network_ping_times": [] 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "pool_stats": [ 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": 1, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg": 1, 2026-02-19T17:22:09.034 INFO:tasks.workunit.client.0.trial119.stdout: "stat_sum": { 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes": 52200, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects": 101, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_clones": 1, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_object_copies": 303, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing_on_primary": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_missing": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_degraded": 101, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_misplaced": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_unfound": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_dirty": 101, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_whiteouts": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_read": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_read_kb": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_write": 101, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_write_kb": 101, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_scrub_errors": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_shallow_scrub_errors": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_deep_scrub_errors": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_recovered": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_recovered": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_keys_recovered": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_omap": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_hit_set_archive": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_bytes_hit_set_archive": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_kb": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_kb": 0, 2026-02-19T17:22:09.035 INFO:tasks.workunit.client.0.trial119.stdout: "num_promote": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_high": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_flush_mode_low": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_some": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_evict_mode_full": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_pinned": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_legacy_snapsets": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_large_omap_objects": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_manifest": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_bytes": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_omap_keys": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_objects_repaired": 0 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "store_stats": { 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "total": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "available": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "internally_reserved": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "allocated": 1241088, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "data_stored": 1241088, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_allocated": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "data_compressed_original": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "omap_allocated": 0, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "internal_metadata": 0 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "log_size": 18, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "ondisk_log_size": 18, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "up": 3, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "acting": 3, 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "num_store_stats": 3 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.036 INFO:tasks.workunit.client.0.trial119.stdout: "osd_stats": [ 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 188978561034 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 42949672975 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "seq": 206158430217 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_state": [ 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "state": "active+undersized+degraded", 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "num": 1 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "pool_pg_unavailable_map": [ 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "poolid": "1", 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "pgs": [] 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "num_pg_by_osd": [ 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2147483647, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:22:09.037 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 2, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 0, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 1, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 1, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "osd": 1, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_primary_pg": 0, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_acting_pg": 0, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "num_up_not_acting_pg": 0 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": [ 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "pool": 1, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "purged_snaps": {} 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: ], 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "servicemap": { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "epoch": 3, 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "modified": "2026-02-19T17:21:18.470401+0000", 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "services": { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "osd": { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "daemons": { 2026-02-19T17:22:09.038 INFO:tasks.workunit.client.0.trial119.stdout: "summary": "", 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "0": { 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "2": { 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "start_epoch": 0, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "start_stamp": "0.000000", 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "gid": 0, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "metadata": {}, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "task_status": {} 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: }, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_first_committed": 1, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "mgrstat_last_committed": 60, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "logm_first_committed": 1, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "logm_last_committed": 309, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "paxos": { 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "first_committed": 1, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "last_committed": 428, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "last_pn": 0, 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: "accepted_pn": 0 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout: } 2026-02-19T17:22:09.039 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:22:09.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-19T17:22:09.040 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery 2026-02-19T17:22:09.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-19T17:22:09.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:09.195 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:09.195 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T17:21:34.194893+0000 41'102 49:144 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:02:02.299583+0000 0 0 2026-02-19T17:22:09.195 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:09.195 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:09.195 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:09.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:22:09.205 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-19T17:22:09.205 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-19T17:22:09.205 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-19T17:22:09.205 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:22:09.205 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:09.205 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:22:09.206 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.0.asok 2026-02-19T17:22:09.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T17:22:09.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.0.asok set_recovery_delay 100000 2026-02-19T17:22:09.263 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:22:09.269 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-19T17:22:09.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-19T17:22:09.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-19T17:22:09.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-19T17:22:09.271 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:22:09.271 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:09.271 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:22:09.271 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.2.asok 2026-02-19T17:22:09.272 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T17:22:09.272 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.2.asok set_recovery_delay 100000 2026-02-19T17:22:09.326 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:22:09.332 INFO:tasks.workunit.client.0.trial119.stdout:revive divergent 1 2026-02-19T17:22:09.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-19T17:22:09.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:09.541 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:09.541 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T17:21:34.194893+0000 41'102 49:144 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:02:02.299583+0000 0 0 2026-02-19T17:22:09.541 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:09.542 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:09.542 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:09.551 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-19T17:22:09.878 INFO:tasks.workunit.client.0.trial119.stderr:noup is set 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:22:09.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:22:09.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:22:09.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:09.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:09.889 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:09.889 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:09.889 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:22:09.889 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:22:09.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:22:09.891 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:22:09.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:22:09.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:22:09.892 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:22:09.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:22:09.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:22:09.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:22:09.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:22:09.917 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:09.907+0000 7fd436eaca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:09.918 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:09.911+0000 7fd436eaca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:09.919 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:09.911+0000 7fd436eaca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:10.106 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-19T17:22:10.106 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-19T17:22:10.295 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:10.287+0000 7fd436eaca40 -1 Falling back to public interface 2026-02-19T17:22:10.944 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:10.935+0000 7fd436eaca40 -1 osd.1 29 log_to_monitors true 2026-02-19T17:22:15.107 INFO:tasks.workunit.client.0.trial119.stdout:delay recovery divergent 2026-02-19T17:22:15.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-19T17:22:15.108 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:15.307 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:15.308 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-19T17:21:34.194893+0000 41'102 52:150 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-20T20:02:02.299583+0000 0 0 2026-02-19T17:22:15.308 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:15.308 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:15.308 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:15.318 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-19T17:22:15.319 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-19T17:22:15.319 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-19T17:22:15.319 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:22:15.320 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:15.320 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:22:15.320 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.20601/ceph-osd.1.asok 2026-02-19T17:22:15.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-19T17:22:15.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.20601/ceph-osd.1.asok set_recovery_delay 100000 2026-02-19T17:22:15.387 INFO:tasks.workunit.client.0.trial119.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-19T17:22:15.393 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-19T17:22:15.719 INFO:tasks.workunit.client.0.trial119.stderr:noup is unset 2026-02-19T17:22:15.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-19T17:22:15.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:15.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:22:15.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:15.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:15.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:15.731 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:15.731 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:15.732 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:15.732 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:22:15.950 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 44 up_thru 48 down_at 43 last_clean_interval [36,41) [v2:127.0.0.1:6800/1341520464,v1:127.0.0.1:6801/1341520464] [v2:127.0.0.1:6802/1341520464,v1:127.0.0.1:6803/1341520464] exists,up 2b6b831d-9cc0-4674-aa88-afd959b56da2 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:15.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:15.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:15.953 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:15.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:15.954 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:15.954 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:22:16.165 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 54 up_thru 54 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/496820400,v1:127.0.0.1:6819/496820400] [v2:127.0.0.1:6820/496820400,v1:127.0.0.1:6821/496820400] exists,up cbf446a6-b895-4ce0-a417-62785f1f4f57 2026-02-19T17:22:16.166 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:16.166 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:16.166 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:16.166 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-19T17:22:16.167 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:16.167 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:22:16.167 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:16.167 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:16.167 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:16.167 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:16.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:16.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:16.168 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:22:16.377 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 48 up_thru 0 down_at 47 last_clean_interval [38,41) [v2:127.0.0.1:6810/933672420,v1:127.0.0.1:6811/933672420] [v2:127.0.0.1:6812/933672420,v1:127.0.0.1:6813/933672420] exists,up f315e90f-9f3c-45cf-a1b3-5e9a8c9cabab 2026-02-19T17:22:16.377 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:16.378 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:16.378 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:16.378 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:16.578 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:16.578 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-19T17:22:15.993096+0000 41'102 56:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:22:16.578 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:16.578 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:16.578 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:16.587 INFO:tasks.workunit.client.0.trial119.stdout:wait for peering 2026-02-19T17:22:16.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-19T17:22:16.587 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:16.788 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:16.788 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-19T17:22:15.993096+0000 41'102 56:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:22:16.789 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:16.789 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:16.789 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:16.797 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.WrwA8zssKl 2026-02-19T17:22:16.821 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.WrwA8zssKl 2026-02-19T17:22:16.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-19T17:22:16.822 INFO:tasks.workunit.client.0.trial119.stdout:killing divergent 1 2026-02-19T17:22:16.822 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:17.024 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:17.024 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-19T17:22:15.993096+0000 41'102 56:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:22:17.024 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:17.024 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:17.024 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:17.034 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-19T17:22:17.035 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:22:17.035 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:22:17.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:22:17.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:22:17.035 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:22:17.143 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:22:17.144 INFO:tasks.workunit.client.0.trial119.stdout:reviving divergent 1 2026-02-19T17:22:17.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-19T17:22:17.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:17.342 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:17.342 INFO:tasks.workunit.client.0.trial119.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-19T17:22:15.993096+0000 41'102 56:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 no scrub is scheduled 0 0 2026-02-19T17:22:17.343 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:17.343 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:17.343 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:17.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-19T17:22:17.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-19T17:22:17.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:22:17.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:22:17.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:22:17.355 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:22:17.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:22:17.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:22:17.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:22:17.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:22:17.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-19T17:22:17.357 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:22:17.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:22:17.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=4807f673-6eb2-4592-bb90-c84d4f1124e4 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.20601/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:22:17.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-19T17:22:17.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:22:17.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:22:17.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:22:17.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:22:17.382 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:17.375+0000 7f1d6cf4aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:17.383 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:17.375+0000 7f1d6cf4aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:17.384 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:17.375+0000 7f1d6cf4aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:17.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:22:17.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:17.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:22:17.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:17.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:17.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:17.571 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:17.572 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:17.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:17.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:22:17.779 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 54 up_thru 54 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/496820400,v1:127.0.0.1:6819/496820400] [v2:127.0.0.1:6820/496820400,v1:127.0.0.1:6821/496820400] exists,up cbf446a6-b895-4ce0-a417-62785f1f4f57 2026-02-19T17:22:17.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:17.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:17.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:17.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-19T17:22:17.843 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:17.835+0000 7f1d6cf4aa40 -1 Falling back to public interface 2026-02-19T17:22:18.554 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:18.547+0000 7f1d6cf4aa40 -1 osd.1 56 log_to_monitors true 2026-02-19T17:22:37.781 INFO:tasks.workunit.client.0.trial119.stdout:allowing recovery 2026-02-19T17:22:37.781 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-19T17:22:37.781 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:37.979 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:37.980 INFO:tasks.workunit.client.0.trial119.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-19T17:22:18.942768+0000 56'103 60:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-21T03:06:58.184136+0000 0 0 2026-02-19T17:22:37.980 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:37.980 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:37.980 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:37.988 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-19T17:22:37.988 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-19T17:22:38.078 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:22:38.087 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-19T17:22:38.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-19T17:22:38.158 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:22:38.166 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-19T17:22:38.166 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-19T17:22:38.246 INFO:tasks.workunit.client.0.trial119.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-19T17:22:38.253 INFO:tasks.workunit.client.0.trial119.stdout:reading divergent objects 2026-02-19T17:22:38.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-19T17:22:38.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-19T17:22:38.464 INFO:tasks.workunit.client.0.trial119.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-19T17:22:38.464 INFO:tasks.workunit.client.0.trial119.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-19T17:22:18.942768+0000 56'103 60:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-19T17:20:22.275266+0000 0'0 2026-02-19T17:20:22.275266+0000 0 0 periodic scrub scheduled @ 2026-02-21T03:06:58.184136+0000 0 0 2026-02-19T17:22:38.464 INFO:tasks.workunit.client.0.trial119.stdout: 2026-02-19T17:22:38.464 INFO:tasks.workunit.client.0.trial119.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-19T17:22:38.464 INFO:tasks.workunit.client.0.trial119.stderr:dumped pgs 2026-02-19T17:22:38.474 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-19T17:22:38.475 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-19T17:22:38.476 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:22:38.476 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-19T17:22:38.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:22:38.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-19T17:22:38.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:22:38.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-19T17:22:38.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-19T17:22:38.552 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-19T17:22:38.580 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-19T17:22:38.582 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-19T17:22:38.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:22:38.587 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-19T17:20:35.583151+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:22:38.587 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 20 _merge_object_divergent_entries: keeping 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-19T17:20:35.583151+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-19T17:22:38.587 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:22:38.587 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 28'99 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-19T17:22:38.587 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-19T17:22:38.587 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-19T17:22:38.587 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-19T17:20:40.455275+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 20 _merge_object_divergent_entries: keeping 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-19T17:20:40.455275+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 28'99 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 29'104 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4563.0:1 2026-02-19T17:20:40.455275+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-19T17:22:38.588 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-19T17:22:38.589 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-19T17:20:39.383939+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-19T17:20:40.379010+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:22:38.589 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4554.0:1 2026-02-19T17:20:39.383939+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:22:38.589 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 20 _merge_object_divergent_entries: keeping 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-19T17:20:40.379010+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:22:38.589 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-19T17:22:38.589 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'102 2026-02-19T17:22:38.589 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-19T17:22:38.589 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-19T17:22:38.590 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'104 2026-02-19T17:22:38.590 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-19T17:20:40.379010+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-19T17:22:38.590 INFO:tasks.workunit.client.0.trial119.stdout:td/divergent-priors/osd.1.log:2026-02-19T17:22:15.987+0000 7fd414e2a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-19T17:22:38.590 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-19T17:22:38.591 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-19T17:22:38.594 INFO:tasks.workunit.client.0.trial119.stdout:success 2026-02-19T17:22:38.595 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-19T17:22:38.595 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-19T17:22:38.596 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-19T17:22:38.596 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-19T17:22:38.858 INFO:tasks.workunit.client.0.trial119.stderr:pool 'test' does not exist 2026-02-19T17:22:38.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-19T17:22:38.868 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:22:38.868 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:22:38.868 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:22:38.868 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:22:38.868 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:22:44.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:22:44.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-19T17:22:44.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:22:44.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:22:44.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:22:44.184 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:22:44.184 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:22:44.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:22:44.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:22:44.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:22:44.192 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:22:44.193 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:22:44.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:22:44.194 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:22:44.196 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:22:44.196 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:22:44.196 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:22:44.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:22:44.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:22:44.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:22:44.198 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:22:44.199 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:22:44.200 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:22:44.200 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:22:44.223 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:22:44.223 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.223 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:22:44.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:22:44.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:22:44.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:22:44.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-19T17:22:44.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/divergent-priors 0 2026-02-19T17:22:44.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-19T17:22:44.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T17:22:44.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-19T17:22:44.225 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:22:44.225 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:22:44.226 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:22:44.226 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:22:44.226 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:22:44.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:22:44.229 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:22:44.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:22:44.230 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:22:44.232 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:22:44.232 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:22:44.232 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:22:44.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:22:44.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:22:44.234 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:22:44.234 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:22:44.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:22:44.236 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T17:22:44.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-19T17:22:44.238 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:22:44.238 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.238 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.20601 2026-02-19T17:22:44.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.20601 2026-02-19T17:22:44.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:22:44.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:22:44.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-19T17:22:44.240 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T17:22:44.240 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T17:22:44.248 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-19T17:22:44.248 DEBUG:teuthology.orchestra.run.trial119:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-19T17:22:44.299 INFO:tasks.workunit.client.0.trial119.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T17:22:44.302 INFO:tasks.workunit.client.0.trial119.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T17:22:44.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:22:44.302 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/ec-error-rollforward 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-19T17:22:44.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-19T17:22:44.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-19T17:22:44.304 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-19T17:22:44.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none ' 2026-02-19T17:22:44.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-19T17:22:44.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-19T17:22:44.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-19T17:22:44.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-19T17:22:44.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-19T17:22:44.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-19T17:22:44.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-19T17:22:44.306 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-19T17:22:44.306 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T17:22:44.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-19T17:22:44.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-19T17:22:44.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-19T17:22:44.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-19T17:22:44.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-19T17:22:44.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-19T17:22:44.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:22:44.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-19T17:22:44.309 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:22:44.309 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:22:44.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:22:44.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:22:44.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:22:44.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:22:44.310 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:22:44.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:22:44.310 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:22:44.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:22:44.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:22:44.311 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:22:44.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:22:44.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:22:44.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:22:44.313 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:22:44.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:22:44.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:22:44.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-19T17:22:44.317 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:22:44.317 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.317 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:44.317 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.77043 2026-02-19T17:22:44.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:22:44.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:22:44.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-19T17:22:44.320 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:22:44.320 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.320 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:44.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.77043 2026-02-19T17:22:44.321 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:22:44.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T17:22:44.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T17:22:44.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:22:44.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-19T17:22:44.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-19T17:22:44.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-19T17:22:44.323 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-19T17:22:44.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-19T17:22:44.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:22:44.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:22:44.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:22:44.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-19T17:22:44.324 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-19T17:22:44.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:22:44.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:44.346 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:44.346 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:44.346 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.346 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:44.346 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:44.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:22:44.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:22:44.376 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:22:44.376 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:22:44.376 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:22:44.376 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:22:44.376 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:22:44.376 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:22:44.377 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:22:44.377 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:22:44.378 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:22:44.378 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.378 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:44.378 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.77043/ceph-mon.a.asok 2026-02-19T17:22:44.378 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:22:44.378 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.77043/ceph-mon.a.asok config get fsid 2026-02-19T17:22:44.432 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:22:44.432 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:22:44.432 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:22:44.432 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:22:44.432 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:22:44.433 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:22:44.433 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:22:44.433 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:22:44.433 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:22:44.434 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.434 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:44.434 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.77043/ceph-mon.a.asok 2026-02-19T17:22:44.434 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:22:44.434 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.77043/ceph-mon.a.asok config get mon_host 2026-02-19T17:22:44.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-19T17:22:44.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-19T17:22:44.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:22:44.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:22:44.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:22:44.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-19T17:22:44.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:22:44.596 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:22:44.596 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:44.596 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:44.596 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:44.596 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.596 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:44.596 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:44.597 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:22:44.597 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:22:44.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-19T17:22:44.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T17:22:44.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:22:44.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:22:44.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:22:44.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-19T17:22:44.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:22:44.619 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:22:44.620 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:44.621 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:44.621 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:44.621 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:44.621 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:44.621 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:44.621 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:44.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:22:44.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:22:44.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:22:44.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:22:44.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:22:44.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:22:44.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:22:44.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:22:44.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:22:44.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:22:44.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:22:44.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-19T17:22:44.623 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:22:44.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d8feeaee-5aa7-4e91-a5e9-5eddf4619785 2026-02-19T17:22:44.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d8feeaee-5aa7-4e91-a5e9-5eddf4619785' 2026-02-19T17:22:44.625 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 d8feeaee-5aa7-4e91-a5e9-5eddf4619785 2026-02-19T17:22:44.625 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:22:44.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDkRpdpKuZHJRAAzwctGnrKtBAobhW9qL1mYw== 2026-02-19T17:22:44.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDkRpdpKuZHJRAAzwctGnrKtBAobhW9qL1mYw=="}' 2026-02-19T17:22:44.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d8feeaee-5aa7-4e91-a5e9-5eddf4619785 -i td/ec-error-rollforward/0/new.json 2026-02-19T17:22:44.739 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:44.747 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-19T17:22:44.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkRpdpKuZHJRAAzwctGnrKtBAobhW9qL1mYw== --osd-uuid d8feeaee-5aa7-4e91-a5e9-5eddf4619785 2026-02-19T17:22:44.764 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:44.754+0000 7f30cea83a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:44.765 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:44.754+0000 7f30cea83a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:44.766 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:44.758+0000 7f30cea83a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:44.767 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:44.758+0000 7f30cea83a40 -1 bdev(0x56419d518400 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:22:44.767 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:44.758+0000 7f30cea83a40 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-19T17:22:45.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-19T17:22:45.529 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:22:45.530 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:22:45.530 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:22:45.530 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:22:45.651 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:22:45.652 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:22:45.652 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:22:45.652 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:22:45.652 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:22:45.652 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:22:45.675 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:45.666+0000 7ffb1205ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:45.678 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:45.670+0000 7ffb1205ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:45.679 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:45.670+0000 7ffb1205ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:45.758 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:22:45.758 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:45.759 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:22:45.759 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:45.759 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:45.759 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:45.759 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:45.759 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:45.760 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:45.760 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:22:45.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:22:46.279 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:46.270+0000 7ffb1205ea40 -1 Falling back to public interface 2026-02-19T17:22:46.863 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:22:46.863 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:46.863 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:22:46.864 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:22:46.864 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:46.864 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:22:46.968 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:22:47.456 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:47.226+0000 7ffb1205ea40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:22:47.970 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:22:47.970 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:47.971 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:22:47.972 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:22:47.972 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:47.972 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:22:48.180 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/585581878,v1:127.0.0.1:6801/585581878] [v2:127.0.0.1:6802/585581878,v1:127.0.0.1:6803/585581878] exists,up d8feeaee-5aa7-4e91-a5e9-5eddf4619785 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:22:48.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:48.183 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:22:48.184 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=75994549-042d-42f5-922f-ab541200fe7d 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stdout:add osd1 75994549-042d-42f5-922f-ab541200fe7d 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 75994549-042d-42f5-922f-ab541200fe7d' 2026-02-19T17:22:48.185 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:22:48.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDoRpdpHb9uCxAA42K8AqcW3yLkZfxe5s14Qw== 2026-02-19T17:22:48.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDoRpdpHb9uCxAA42K8AqcW3yLkZfxe5s14Qw=="}' 2026-02-19T17:22:48.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 75994549-042d-42f5-922f-ab541200fe7d -i td/ec-error-rollforward/1/new.json 2026-02-19T17:22:48.412 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:22:48.423 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-19T17:22:48.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDoRpdpHb9uCxAA42K8AqcW3yLkZfxe5s14Qw== --osd-uuid 75994549-042d-42f5-922f-ab541200fe7d 2026-02-19T17:22:48.448 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:48.438+0000 7f7c6a4efa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:48.449 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:48.438+0000 7f7c6a4efa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:48.450 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:48.442+0000 7f7c6a4efa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:48.451 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:48.442+0000 7f7c6a4efa40 -1 bdev(0x55e4b3730400 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-19T17:22:48.451 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:48.442+0000 7f7c6a4efa40 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-19T17:22:49.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-19T17:22:49.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:22:49.112 INFO:tasks.workunit.client.0.trial119.stdout:adding osd1 key to auth repository 2026-02-19T17:22:49.112 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T17:22:49.112 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:22:49.401 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:22:49.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T17:22:49.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:22:49.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:22:49.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:22:49.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:22:49.418 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:49.410+0000 7fcf4c0d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:49.419 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:49.410+0000 7fcf4c0d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:49.420 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:49.410+0000 7fcf4c0d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:49.612 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:49.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:49.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:22:49.779 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:49.770+0000 7fcf4c0d6a40 -1 Falling back to public interface 2026-02-19T17:22:49.825 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:22:50.467 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:50.458+0000 7fcf4c0d6a40 -1 osd.1 0 log_to_monitors true 2026-02-19T17:22:50.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:22:50.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:50.826 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:22:50.826 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:22:50.827 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:50.827 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:22:51.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:22:52.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:22:52.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:52.039 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:22:52.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:22:52.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:52.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:22:52.246 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2696385121,v1:127.0.0.1:6811/2696385121] [v2:127.0.0.1:6812/2696385121,v1:127.0.0.1:6813/2696385121] exists,up 75994549-042d-42f5-922f-ab541200fe7d 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:22:52.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:52.251 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:22:52.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:22:52.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:22:52.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:22:52.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:22:52.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-19T17:22:52.253 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:22:52.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=10e840f9-7157-4fd5-a890-a14437e4c1ef 2026-02-19T17:22:52.254 INFO:tasks.workunit.client.0.trial119.stdout:add osd2 10e840f9-7157-4fd5-a890-a14437e4c1ef 2026-02-19T17:22:52.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 10e840f9-7157-4fd5-a890-a14437e4c1ef' 2026-02-19T17:22:52.254 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:22:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDsRpdpQzRrDxAAyGFOuONhS8dLdE6EqWGAzQ== 2026-02-19T17:22:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDsRpdpQzRrDxAAyGFOuONhS8dLdE6EqWGAzQ=="}' 2026-02-19T17:22:52.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 10e840f9-7157-4fd5-a890-a14437e4c1ef -i td/ec-error-rollforward/2/new.json 2026-02-19T17:22:52.487 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:22:52.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-19T17:22:52.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDsRpdpQzRrDxAAyGFOuONhS8dLdE6EqWGAzQ== --osd-uuid 10e840f9-7157-4fd5-a890-a14437e4c1ef 2026-02-19T17:22:52.522 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:52.514+0000 7f498fe75a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:52.523 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:52.514+0000 7f498fe75a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:52.525 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:52.514+0000 7f498fe75a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:52.525 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:52.514+0000 7f498fe75a40 -1 bdev(0x55bf5d590400 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-19T17:22:52.526 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:52.518+0000 7f498fe75a40 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-19T17:22:53.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-19T17:22:53.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:22:53.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T17:22:53.239 INFO:tasks.workunit.client.0.trial119.stdout:adding osd2 key to auth repository 2026-02-19T17:22:53.239 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:22:53.530 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:22:53.530 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T17:22:53.530 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:22:53.530 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:22:53.531 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:22:53.531 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:22:53.552 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:53.542+0000 7f90fd839a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:53.554 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:53.546+0000 7f90fd839a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:53.555 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:53.546+0000 7f90fd839a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:53.744 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T17:22:53.744 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:53.744 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:22:53.744 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:53.744 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:53.745 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:53.745 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:53.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:53.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:53.746 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:22:53.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:22:53.959 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:53.950+0000 7f90fd839a40 -1 Falling back to public interface 2026-02-19T17:22:54.535 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:54.526+0000 7f90fd839a40 -1 osd.2 0 log_to_monitors true 2026-02-19T17:22:54.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:22:54.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:54.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:22:54.952 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:22:54.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:54.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:22:55.159 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1183891157,v1:127.0.0.1:6819/1183891157] [v2:127.0.0.1:6820/1183891157,v1:127.0.0.1:6821/1183891157] exists,up 10e840f9-7157-4fd5-a890-a14437e4c1ef 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:22:55.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:22:55.161 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:22:55.161 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:22:55.161 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:22:55.161 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:22:55.161 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:22:55.161 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:22:55.161 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:22:55.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-19T17:22:55.163 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:22:55.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6c0dcfd2-f620-4e46-8df7-22ff041466ba 2026-02-19T17:22:55.164 INFO:tasks.workunit.client.0.trial119.stdout:add osd3 6c0dcfd2-f620-4e46-8df7-22ff041466ba 2026-02-19T17:22:55.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 6c0dcfd2-f620-4e46-8df7-22ff041466ba' 2026-02-19T17:22:55.164 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:22:55.176 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDvRpdp+EwwChAAmkwjNzNn6SppvmrQcEFK6w== 2026-02-19T17:22:55.176 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDvRpdp+EwwChAAmkwjNzNn6SppvmrQcEFK6w=="}' 2026-02-19T17:22:55.176 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6c0dcfd2-f620-4e46-8df7-22ff041466ba -i td/ec-error-rollforward/3/new.json 2026-02-19T17:22:55.395 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:22:55.406 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-19T17:22:55.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDvRpdp+EwwChAAmkwjNzNn6SppvmrQcEFK6w== --osd-uuid 6c0dcfd2-f620-4e46-8df7-22ff041466ba 2026-02-19T17:22:55.431 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:55.422+0000 7fe3b2187a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:55.432 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:55.422+0000 7fe3b2187a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:55.433 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:55.422+0000 7fe3b2187a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:55.434 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:55.426+0000 7fe3b2187a40 -1 bdev(0x56123ec24400 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-19T17:22:55.434 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:55.426+0000 7fe3b2187a40 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-19T17:22:56.127 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-19T17:22:56.127 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:22:56.128 INFO:tasks.workunit.client.0.trial119.stdout:adding osd3 key to auth repository 2026-02-19T17:22:56.129 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-19T17:22:56.129 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:22:56.416 INFO:tasks.workunit.client.0.trial119.stdout:start osd.3 2026-02-19T17:22:56.416 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-19T17:22:56.416 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:22:56.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:22:56.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:22:56.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:22:56.438 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:56.430+0000 7f00560f2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:56.440 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:56.430+0000 7f00560f2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:56.441 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:56.430+0000 7f00560f2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:22:56.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-19T17:22:56.629 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:22:56.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T17:22:56.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:22:56.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:22:56.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:56.630 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:22:56.630 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:22:56.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:56.631 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:22:56.839 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:22:56.887 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:56.878+0000 7f00560f2a40 -1 Falling back to public interface 2026-02-19T17:22:57.523 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:22:57.514+0000 7f00560f2a40 -1 osd.3 0 log_to_monitors true 2026-02-19T17:22:57.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:22:57.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:57.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:22:57.841 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:22:57.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:57.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:22:58.046 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:22:59.047 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:22:59.047 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:22:59.047 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:22:59.048 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:22:59.048 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:22:59.048 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:22:59.250 INFO:tasks.workunit.client.0.trial119.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2522322196,v1:127.0.0.1:6827/2522322196] [v2:127.0.0.1:6828/2522322196,v1:127.0.0.1:6829/2522322196] exists,up 6c0dcfd2-f620-4e46-8df7-22ff041466ba 2026-02-19T17:22:59.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:22:59.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:22:59.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:22:59.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-19T17:22:59.516 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-19T17:22:59.911 INFO:tasks.workunit.client.0.trial119.stderr:pool 'ec' already exists 2026-02-19T17:22:59.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-19T17:23:01.516 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-19T17:23:01.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 81347 2026-02-19T17:23:01.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=83348 2026-02-19T17:23:01.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-19T17:23:01.517 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-19T17:23:02.520 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 83369' 2026-02-19T17:23:02.520 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-19T17:23:02.520 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 83370' 2026-02-19T17:23:02.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-19T17:23:02.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 83371' 2026-02-19T17:23:02.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-19T17:23:02.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-19T17:23:03.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-19T17:23:03.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:23:03.522 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:23:03.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:23:03.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:23:03.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:23:03.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:23:03.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 83348 83369 83370 83371 2026-02-19T17:23:03.634 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:03.638 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:03.639 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:23:03.640 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:23:03.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-19T17:23:03.641 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:23:03.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:23:03.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:03.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-19T17:23:03.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:23:03.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:23:03.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:23:03.643 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:23:03.655 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:03.646+0000 7fd8b45d7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:03.656 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:03.646+0000 7fd8b45d7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:03.657 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:03.646+0000 7fd8b45d7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:03.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/585581878,v1:127.0.0.1:6801/585581878] [v2:127.0.0.1:6802/585581878,v1:127.0.0.1:6803/585581878] exists,up d8feeaee-5aa7-4e91-a5e9-5eddf4619785 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:23:04.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:23:04.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:23:04.058 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:23:04.059 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:04.059 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-19T17:23:04.059 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:23:04.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:23:04.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:23:04.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:23:04.063 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.054+0000 7fd8b45d7a40 -1 Falling back to public interface 2026-02-19T17:23:04.082 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.074+0000 7f72c7f1aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.084 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.074+0000 7f72c7f1aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.085 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.074+0000 7f72c7f1aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.270 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:23:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:23:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:04.271 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:04.271 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:04.272 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:04.272 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:23:04.482 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 10 up_thru 21 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2696385121,v1:127.0.0.1:6811/2696385121] [v2:127.0.0.1:6812/2696385121,v1:127.0.0.1:6813/2696385121] exists,up 75994549-042d-42f5-922f-ab541200fe7d 2026-02-19T17:23:04.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:04.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:04.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:04.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-19T17:23:04.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T17:23:04.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:23:04.485 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:23:04.486 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:04.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:04.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:04.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:04.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:23:04.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:23:04.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-19T17:23:04.488 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:23:04.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:23:04.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:04.489 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-19T17:23:04.490 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:23:04.490 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:23:04.490 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:23:04.490 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:23:04.502 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.494+0000 7fea97e91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.503 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.494+0000 7fea97e91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.504 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.494+0000 7fea97e91a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.583 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.574+0000 7f72c7f1aa40 -1 Falling back to public interface 2026-02-19T17:23:04.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:23:04.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:04.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:23:04.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:04.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:04.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:04.696 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:04.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:04.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:04.696 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:23:04.906 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1183891157,v1:127.0.0.1:6819/1183891157] [v2:127.0.0.1:6820/1183891157,v1:127.0.0.1:6821/1183891157] exists,up 10e840f9-7157-4fd5-a890-a14437e4c1ef 2026-02-19T17:23:04.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:04.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:04.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:04.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-19T17:23:04.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' 2026-02-19T17:23:04.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:23:04.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-19T17:23:04.913 INFO:tasks.workunit.client.0.trial119.stdout:start osd.3 2026-02-19T17:23:04.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T17:23:04.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=f0d6d69e-a9ec-4a4f-abc9-08e2fc5486ad --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77043/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:04.914 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-19T17:23:04.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T17:23:04.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:23:04.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:23:04.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:23:04.928 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.918+0000 7f3239fcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.930 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.918+0000 7f3239fcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:04.930 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:04.922+0000 7f3239fcda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:05.031 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:05.022+0000 7fea97e91a40 -1 Falling back to public interface 2026-02-19T17:23:05.037 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:05.026+0000 7fd8b45d7a40 -1 osd.0 23 log_to_monitors true 2026-02-19T17:23:05.121 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T17:23:05.121 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:05.121 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T17:23:05.122 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:05.122 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:05.122 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:05.122 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:05.123 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:05.123 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:05.123 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:23:05.329 INFO:tasks.workunit.client.0.trial119.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2522322196,v1:127.0.0.1:6827/2522322196] [v2:127.0.0.1:6828/2522322196,v1:127.0.0.1:6829/2522322196] exists,up 6c0dcfd2-f620-4e46-8df7-22ff041466ba 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:23:05.330 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:23:05.331 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:23:05.331 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:23:05.331 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:23:05.331 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:23:05.331 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:23:05.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:23:05.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:23:05.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:23:05.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:23:05.424 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:23:05.425 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:23:05.451 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:05.442+0000 7f3239fcda40 -1 Falling back to public interface 2026-02-19T17:23:05.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:23:05.641 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:23:05.641 INFO:tasks.workunit.client.0.trial119.stderr:2 2026-02-19T17:23:05.642 INFO:tasks.workunit.client.0.trial119.stderr:3' 2026-02-19T17:23:05.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:23:05.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:23:05.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:23:05.711 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:05.702+0000 7f72c7f1aa40 -1 osd.1 23 log_to_monitors true 2026-02-19T17:23:05.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149699 2026-02-19T17:23:05.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149699 2026-02-19T17:23:05.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149699' 2026-02-19T17:23:05.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:23:05.723 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:23:06.054 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:06.045+0000 7fea97e91a40 -1 osd.2 22 log_to_monitors true 2026-02-19T17:23:06.384 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:06.373+0000 7f3239fcda40 -1 osd.3 23 log_to_monitors true 2026-02-19T17:23:10.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018884 2026-02-19T17:23:10.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018884 2026-02-19T17:23:10.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149699 1-128849018884' 2026-02-19T17:23:10.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:23:10.807 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:23:10.886 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-19T17:23:10.886 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-19T17:23:10.887 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149699 1-128849018884 2-146028888067' 2026-02-19T17:23:10.887 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:23:10.887 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-19T17:23:10.965 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-19T17:23:10.965 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-19T17:23:10.965 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149699 1-128849018884 2-146028888067 3-154618822659' 2026-02-19T17:23:10.965 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:23:10.965 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-111669149699 2026-02-19T17:23:10.966 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:23:10.966 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:23:10.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-111669149699 2026-02-19T17:23:10.967 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:23:10.969 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149699 2026-02-19T17:23:10.969 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 111669149699' 2026-02-19T17:23:10.969 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 111669149699 2026-02-19T17:23:10.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:23:11.190 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149700 -lt 111669149699 2026-02-19T17:23:11.191 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:23:11.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-128849018884 2026-02-19T17:23:11.191 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:23:11.192 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:23:11.193 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-128849018884 2026-02-19T17:23:11.193 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:23:11.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018884 2026-02-19T17:23:11.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 128849018884' 2026-02-19T17:23:11.195 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 128849018884 2026-02-19T17:23:11.195 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:23:11.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018884 2026-02-19T17:23:11.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:23:11.408 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-146028888067 2026-02-19T17:23:11.408 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:23:11.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:23:11.410 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-146028888067 2026-02-19T17:23:11.410 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:23:11.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888067 2026-02-19T17:23:11.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 146028888067' 2026-02-19T17:23:11.411 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 146028888067 2026-02-19T17:23:11.412 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:23:11.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 146028888067 2026-02-19T17:23:11.632 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:23:12.633 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:23:12.633 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:23:12.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 146028888067 2026-02-19T17:23:12.845 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:23:13.846 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T17:23:13.847 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:23:14.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888068 -lt 146028888067 2026-02-19T17:23:14.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:23:14.056 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-154618822659 2026-02-19T17:23:14.056 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:23:14.057 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-19T17:23:14.058 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-154618822659 2026-02-19T17:23:14.058 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:23:14.060 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-19T17:23:14.060 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.3 seq 154618822659 2026-02-19T17:23:14.061 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 154618822659' 2026-02-19T17:23:14.061 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-19T17:23:14.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822659 2026-02-19T17:23:14.282 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:23:14.282 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:23:14.282 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:23:14.559 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:23:14.764 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-19T17:23:14.764 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:23:14.765 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:23:14.765 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-19T17:23:15.037 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:23:15.038 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:23:15.038 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:23:15.038 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:23:15.038 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:23:15.347 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:23:15.347 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:23:15.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:23:15.349 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:23:15.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:23:15.351 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:23:15.351 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:23:15.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:15.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:23:15.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:23:15.353 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:15.354 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:23:15.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:23:15.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-19T17:23:15.367 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:23:15.367 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.367 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:23:15.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.77043 2026-02-19T17:23:15.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:23:15.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:23:15.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-19T17:23:15.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/ec-error-rollforward 0 2026-02-19T17:23:15.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-19T17:23:15.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T17:23:15.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-19T17:23:15.370 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:23:15.370 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:23:15.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:23:15.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:23:15.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:23:15.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:23:15.372 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:23:15.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:23:15.373 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:23:15.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:23:15.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:23:15.374 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:23:15.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:15.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:23:15.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:23:15.376 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:15.377 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:23:15.378 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T17:23:15.378 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-19T17:23:15.379 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:23:15.379 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.379 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.77043 2026-02-19T17:23:15.379 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.77043 2026-02-19T17:23:15.380 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:23:15.380 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:23:15.380 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-19T17:23:15.381 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T17:23:15.381 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T17:23:15.430 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-19T17:23:15.431 DEBUG:teuthology.orchestra.run.trial119:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-19T17:23:15.483 INFO:tasks.workunit.client.0.trial119.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T17:23:15.486 INFO:tasks.workunit.client.0.trial119.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bench 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-19T17:23:15.487 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-19T17:23:15.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-19T17:23:15.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-19T17:23:15.488 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-19T17:23:15.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-19T17:23:15.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=d5f7a4d2-4eb7-4be6-9199-073a3f6e73f2 --auth-supported=none ' 2026-02-19T17:23:15.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-19T17:23:15.489 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-19T17:23:15.489 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-19T17:23:15.489 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T17:23:15.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-19T17:23:15.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-19T17:23:15.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-19T17:23:15.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-19T17:23:15.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-19T17:23:15.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-19T17:23:15.491 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:23:15.492 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-19T17:23:15.492 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:23:15.492 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:23:15.492 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:23:15.492 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:23:15.492 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:23:15.493 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:23:15.493 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:23:15.494 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:23:15.494 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:23:15.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:23:15.496 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:23:15.496 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:23:15.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:15.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:23:15.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:23:15.498 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:15.498 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:23:15.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:23:15.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-19T17:23:15.502 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:23:15.502 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.502 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:15.502 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.86013 2026-02-19T17:23:15.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:23:15.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:23:15.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-19T17:23:15.505 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:23:15.505 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.505 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:15.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.86013 2026-02-19T17:23:15.506 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-19T17:23:15.508 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:23:15.509 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:23:15.509 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:23:15.509 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-19T17:23:15.509 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-19T17:23:15.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:23:15.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:15.532 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:15.532 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:15.533 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.533 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:15.533 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86013/$cluster-$name.asok' 2026-02-19T17:23:15.533 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.86013/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:23:15.561 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:23:15.562 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:23:15.562 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:23:15.562 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:23:15.562 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:23:15.562 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:23:15.563 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:23:15.563 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:23:15.563 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:23:15.564 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:23:15.564 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.564 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:15.564 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.86013/ceph-mon.a.asok 2026-02-19T17:23:15.564 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:23:15.564 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.86013/ceph-mon.a.asok config get fsid 2026-02-19T17:23:15.619 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:23:15.619 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:23:15.620 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:23:15.620 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:23:15.620 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:23:15.620 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:23:15.620 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:23:15.620 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:23:15.620 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:23:15.621 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.621 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:15.621 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.86013/ceph-mon.a.asok 2026-02-19T17:23:15.621 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:23:15.621 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.86013/ceph-mon.a.asok config get mon_host 2026-02-19T17:23:15.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-19T17:23:15.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-19T17:23:15.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:23:15.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:23:15.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:23:15.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-19T17:23:15.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:23:15.783 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:23:15.783 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:15.783 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:15.783 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:15.783 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.784 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:15.784 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86013/$cluster-$name.asok' 2026-02-19T17:23:15.784 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:23:15.785 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.86013/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:23:15.804 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d5f7a4d2-4eb7-4be6-9199-073a3f6e73f2 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:15.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.86013/$cluster-$name.asok' 2026-02-19T17:23:15.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.86013/$cluster-$name.asok' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:23:15.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:23:15.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-19T17:23:15.808 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:23:15.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e83f3862-a685-4822-ae56-87fdc791d32d 2026-02-19T17:23:15.808 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e83f3862-a685-4822-ae56-87fdc791d32d' 2026-02-19T17:23:15.809 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 e83f3862-a685-4822-ae56-87fdc791d32d 2026-02-19T17:23:15.809 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:23:15.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQADR5dpadJUMBAAH8n0bzNbwwuXGngfv9NzPg== 2026-02-19T17:23:15.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQADR5dpadJUMBAAH8n0bzNbwwuXGngfv9NzPg=="}' 2026-02-19T17:23:15.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e83f3862-a685-4822-ae56-87fdc791d32d -i td/osd-bench/0/new.json 2026-02-19T17:23:15.924 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:15.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-19T17:23:15.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d5f7a4d2-4eb7-4be6-9199-073a3f6e73f2 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.86013/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADR5dpadJUMBAAH8n0bzNbwwuXGngfv9NzPg== --osd-uuid e83f3862-a685-4822-ae56-87fdc791d32d 2026-02-19T17:23:15.948 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:15.937+0000 7f7a21707a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:15.950 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:15.941+0000 7f7a21707a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:15.951 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:15.941+0000 7f7a21707a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:15.951 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:15.941+0000 7f7a21707a40 -1 bdev(0x55fd0cf16400 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:23:15.952 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:15.941+0000 7f7a21707a40 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-19T17:23:16.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-19T17:23:16.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:23:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:23:16.675 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:23:16.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:23:16.794 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:23:16.795 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:23:16.795 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d5f7a4d2-4eb7-4be6-9199-073a3f6e73f2 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.86013/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:16.795 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:23:16.795 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:23:16.795 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:23:16.818 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:16.809+0000 7f9158b98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:16.821 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:16.809+0000 7f9158b98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:16.823 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:16.813+0000 7f9158b98a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:16.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:23:16.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:16.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:23:16.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:16.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:16.901 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:16.901 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:16.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:16.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:16.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:23:17.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:17.344 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:17.333+0000 7f9158b98a40 -1 Falling back to public interface 2026-02-19T17:23:18.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:18.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:18.007 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:23:18.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:23:18.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:18.007 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:23:18.111 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:18.343 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:18.333+0000 7f9158b98a40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:23:19.113 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:19.113 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:19.114 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:23:19.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:23:19.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:19.114 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:23:19.317 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3683511882,v1:127.0.0.1:6801/3683511882] [v2:127.0.0.1:6802/3683511882,v1:127.0.0.1:6803/3683511882] exists,up e83f3862-a685-4822-ae56-87fdc791d32d 2026-02-19T17:23:19.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:19.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:19.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:19.318 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-19T17:23:19.318 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-19T17:23:19.327 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-19T17:23:19.328 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-19T17:23:19.328 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-19T17:23:19.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-19T17:23:19.342 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-19T17:23:19.342 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-19T17:23:19.351 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-19T17:23:19.351 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-19T17:23:19.351 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-19T17:23:19.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-19T17:23:19.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-19T17:23:19.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-19T17:23:19.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-19T17:23:19.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-19T17:23:19.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-19T17:23:19.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-19T17:23:19.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-19T17:23:19.437 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-19T17:23:19.437 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-19T17:23:19.437 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-19T17:23:19.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-19T17:23:19.440 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-19T17:23:19.510 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-19T17:23:19.510 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-19T17:23:19.510 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-19T17:23:19.511 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-19T17:23:19.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-19T17:23:19.581 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-19T17:23:19.581 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-19T17:23:19.581 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-19T17:23:19.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-19T17:23:19.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-19T17:23:21.239 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:23:21.239 INFO:tasks.workunit.client.0.trial119.stdout: "bytes_written": 1073741824, 2026-02-19T17:23:21.239 INFO:tasks.workunit.client.0.trial119.stdout: "blocksize": 4194304, 2026-02-19T17:23:21.240 INFO:tasks.workunit.client.0.trial119.stdout: "elapsed_sec": 0.72815872999999998, 2026-02-19T17:23:21.240 INFO:tasks.workunit.client.0.trial119.stdout: "bytes_per_sec": 1474598572.7589917, 2026-02-19T17:23:21.240 INFO:tasks.workunit.client.0.trial119.stdout: "iops": 351.57169646239083 2026-02-19T17:23:21.240 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:23:21.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-19T17:23:21.326 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:23:21.326 INFO:tasks.workunit.client.0.trial119.stdout: "bytes_written": 10, 2026-02-19T17:23:21.327 INFO:tasks.workunit.client.0.trial119.stdout: "blocksize": 14456, 2026-02-19T17:23:21.327 INFO:tasks.workunit.client.0.trial119.stdout: "elapsed_sec": 0.00030741699999999999, 2026-02-19T17:23:21.327 INFO:tasks.workunit.client.0.trial119.stdout: "bytes_per_sec": 32529.105417071925, 2026-02-19T17:23:21.327 INFO:tasks.workunit.client.0.trial119.stdout: "iops": 2.2502148185578257 2026-02-19T17:23:21.327 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:23:21.333 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-19T17:23:21.414 INFO:tasks.workunit.client.0.trial119.stdout:{ 2026-02-19T17:23:21.414 INFO:tasks.workunit.client.0.trial119.stdout: "bytes_written": 1, 2026-02-19T17:23:21.414 INFO:tasks.workunit.client.0.trial119.stdout: "blocksize": 14456, 2026-02-19T17:23:21.414 INFO:tasks.workunit.client.0.trial119.stdout: "elapsed_sec": 0.00025555199999999998, 2026-02-19T17:23:21.414 INFO:tasks.workunit.client.0.trial119.stdout: "bytes_per_sec": 3913.0979213623846, 2026-02-19T17:23:21.414 INFO:tasks.workunit.client.0.trial119.stdout: "iops": 0.27069022698965028 2026-02-19T17:23:21.414 INFO:tasks.workunit.client.0.trial119.stdout:} 2026-02-19T17:23:21.421 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-19T17:23:21.421 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-19T17:23:21.421 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:23:21.421 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-19T17:23:21.421 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:23:21.421 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:23:21.422 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:23:21.422 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:23:21.422 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:23:21.731 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:23:21.732 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:23:21.733 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:23:21.733 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:23:21.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:23:21.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:23:21.735 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:23:21.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:21.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:23:21.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:23:21.738 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:21.738 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:23:21.739 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:23:21.740 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-19T17:23:21.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:23:21.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:21.766 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:21.766 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.86013 2026-02-19T17:23:21.768 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bench 0 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:23:21.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:23:21.771 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:23:21.771 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:23:21.772 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:23:21.772 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:23:21.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:23:21.773 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:23:21.774 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:23:21.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:21.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:23:21.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:23:21.775 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:21.776 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:23:21.777 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-19T17:23:21.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-19T17:23:21.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:23:21.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:21.779 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.86013 2026-02-19T17:23:21.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.86013 2026-02-19T17:23:21.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:23:21.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:23:21.780 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-19T17:23:21.781 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-19T17:23:21.781 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T17:23:21.834 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-19T17:23:21.835 DEBUG:teuthology.orchestra.run.trial119:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-19T17:23:21.887 INFO:tasks.workunit.client.0.trial119.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-19T17:23:21.892 INFO:tasks.workunit.client.0.trial119.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bluefs-volume-ops 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:21.893 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-19T17:23:21.894 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-19T17:23:21.894 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:TEST_bluestore2 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:TEST_bluestore_expand' 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:23:21.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T17:23:21.897 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:23:21.897 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:23:21.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:23:21.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:23:21.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:23:21.897 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:23:21.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:23:21.899 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:23:21.899 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:23:21.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:23:21.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:23:21.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:23:21.901 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:21.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:23:21.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:23:21.902 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:23:21.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:23:21.904 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:23:21.904 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T17:23:21.906 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:23:21.906 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:21.906 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:21.906 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.88022 2026-02-19T17:23:21.907 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:23:21.907 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:23:21.908 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-19T17:23:21.908 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:23:21.909 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:21.909 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:21.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.88022 2026-02-19T17:23:21.910 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:23:21.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-19T17:23:21.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-19T17:23:21.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:23:21.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-19T17:23:21.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-19T17:23:21.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:21.912 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-19T17:23:21.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-19T17:23:21.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-19T17:23:21.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-19T17:23:21.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-19T17:23:21.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-19T17:23:21.913 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-19T17:23:21.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=1 ' 2026-02-19T17:23:21.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-19T17:23:21.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:21.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:23:21.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:23:21.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:23:21.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-19T17:23:21.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:21.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:23:21.968 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:23:21.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:23:21.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:23:21.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:23:21.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:23:21.969 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.88022/ceph-mon.a.asok 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:23:21.971 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.88022/ceph-mon.a.asok config get fsid 2026-02-19T17:23:22.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:23:22.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:23:22.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:23:22.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:23:22.028 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:23:22.028 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:23:22.029 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:23:22.029 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:23:22.030 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:23:22.030 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:22.030 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:22.030 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.88022/ceph-mon.a.asok 2026-02-19T17:23:22.030 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:23:22.030 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.88022/ceph-mon.a.asok config get mon_host 2026-02-19T17:23:22.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-19T17:23:22.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:22.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:23:22.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:23:22.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:23:22.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-19T17:23:22.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:23:22.201 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:23:22.202 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:22.202 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:22.202 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:22.202 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:22.202 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:22.202 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:22.203 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:23:22.203 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:23:22.222 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:22.223 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:22.224 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:23:22.225 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:23:22.226 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=35b4d609-ac49-413e-8834-e5803b384135 2026-02-19T17:23:22.226 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 35b4d609-ac49-413e-8834-e5803b384135 2026-02-19T17:23:22.227 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 35b4d609-ac49-413e-8834-e5803b384135' 2026-02-19T17:23:22.227 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:23:22.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAKR5dp4jKtDRAA0BZjre6yGbjWpdIIHRdrPA== 2026-02-19T17:23:22.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAKR5dp4jKtDRAA0BZjre6yGbjWpdIIHRdrPA=="}' 2026-02-19T17:23:22.235 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 35b4d609-ac49-413e-8834-e5803b384135 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-19T17:23:22.343 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:22.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-19T17:23:22.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAKR5dp4jKtDRAA0BZjre6yGbjWpdIIHRdrPA== --osd-uuid 35b4d609-ac49-413e-8834-e5803b384135 2026-02-19T17:23:22.368 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:22.361+0000 7f53f469ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:22.370 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:22.361+0000 7f53f469ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:22.371 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:22.365+0000 7f53f469ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:22.371 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:22.365+0000 7f53f469ca40 -1 bdev(0x563c72dde400 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:23:22.371 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:22.365+0000 7f53f469ca40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-19T17:23:24.153 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-19T17:23:24.153 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:23:24.154 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:23:24.154 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:23:24.155 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:23:24.267 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:23:24.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:23:24.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:24.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:23:24.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:23:24.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:23:24.291 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:24.285+0000 7f8bb639ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:24.295 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:24.289+0000 7f8bb639ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:24.306 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:24.293+0000 7f8bb639ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:24.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:23:24.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:24.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:23:24.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:24.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:24.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:24.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:24.409 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:24.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:24.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:23:24.513 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:24.796 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:24.789+0000 7f8bb639ba40 -1 Falling back to public interface 2026-02-19T17:23:25.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:25.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:25.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:23:25.515 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:23:25.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:25.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:23:25.721 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:25.961 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:25.953+0000 7f8bb639ba40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:23:26.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:26.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:26.723 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:23:26.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:23:26.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:26.723 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:23:26.935 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3680419773,v1:127.0.0.1:6803/3680419773] [v2:127.0.0.1:6804/3680419773,v1:127.0.0.1:6805/3680419773] exists,up 35b4d609-ac49-413e-8834-e5803b384135 2026-02-19T17:23:26.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:26.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:26.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:26.936 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:23:26.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=89420 2026-02-19T17:23:26.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-19T17:23:26.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:26.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:23:26.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-19T17:23:26.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:23:26.940 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:23:26.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:23:26.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:26.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:26.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:26.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:26.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:23:26.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:23:26.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T17:23:26.943 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:23:26.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9d41eda0-56e2-432c-9523-22ae21e660dd 2026-02-19T17:23:26.943 INFO:tasks.workunit.client.0.trial119.stdout:add osd1 9d41eda0-56e2-432c-9523-22ae21e660dd 2026-02-19T17:23:26.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9d41eda0-56e2-432c-9523-22ae21e660dd' 2026-02-19T17:23:26.944 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:23:26.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAOR5dpWqhzOBAAJYoBV8/5N2eymAH9LhlW+A== 2026-02-19T17:23:26.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAOR5dpWqhzOBAAJYoBV8/5N2eymAH9LhlW+A=="}' 2026-02-19T17:23:26.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9d41eda0-56e2-432c-9523-22ae21e660dd -i td/osd-bluefs-volume-ops/1/new.json 2026-02-19T17:23:27.165 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:23:27.175 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-19T17:23:27.176 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAOR5dpWqhzOBAAJYoBV8/5N2eymAH9LhlW+A== --osd-uuid 9d41eda0-56e2-432c-9523-22ae21e660dd 2026-02-19T17:23:27.192 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:27.185+0000 7f9d05c9ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:27.193 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:27.185+0000 7f9d05c9ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:27.194 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:27.189+0000 7f9d05c9ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:27.195 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:27.189+0000 7f9d05c9ea40 -1 bdev(0x5644718d8400 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-19T17:23:27.195 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:27.189+0000 7f9d05c9ea40 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-19T17:23:28.604 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-19T17:23:28.605 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:23:28.606 INFO:tasks.workunit.client.0.trial119.stdout:adding osd1 key to auth repository 2026-02-19T17:23:28.606 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-19T17:23:28.606 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:23:28.885 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:23:28.886 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-19T17:23:28.886 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:28.887 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:23:28.887 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:23:28.887 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:23:28.910 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:28.901+0000 7fe919d12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:28.911 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:28.905+0000 7fe919d12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:28.912 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:28.905+0000 7fe919d12a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:29.092 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-19T17:23:29.092 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:29.092 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:23:29.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:29.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:29.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:29.093 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:29.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:29.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:29.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:23:29.304 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:29.416 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:29.409+0000 7fe919d12a40 -1 Falling back to public interface 2026-02-19T17:23:30.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:30.305 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:30.305 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:23:30.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:23:30.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:30.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:23:30.511 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:30.743 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:30.737+0000 7fe919d12a40 -1 osd.1 0 log_to_monitors true 2026-02-19T17:23:31.512 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:31.513 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:31.513 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:23:31.514 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:23:31.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:31.515 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:23:31.721 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/514457279,v1:127.0.0.1:6811/514457279] [v2:127.0.0.1:6812/514457279,v1:127.0.0.1:6813/514457279] exists,up 9d41eda0-56e2-432c-9523-22ae21e660dd 2026-02-19T17:23:31.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:31.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:31.722 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:31.723 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T17:23:31.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=91943 2026-02-19T17:23:31.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-19T17:23:31.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:31.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:23:31.726 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:23:31.727 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:23:31.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:23:31.729 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:31.729 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:31.729 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:31.729 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:31.729 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:23:31.729 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:23:31.729 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T17:23:31.730 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:23:31.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3de5c323-b138-4e54-b585-94bcdc193a0b 2026-02-19T17:23:31.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 3de5c323-b138-4e54-b585-94bcdc193a0b' 2026-02-19T17:23:31.730 INFO:tasks.workunit.client.0.trial119.stdout:add osd2 3de5c323-b138-4e54-b585-94bcdc193a0b 2026-02-19T17:23:31.731 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:23:31.740 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQATR5dptEvPKxAAsb4g47IHbUlqU+VG7m0sjw== 2026-02-19T17:23:31.741 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQATR5dptEvPKxAAsb4g47IHbUlqU+VG7m0sjw=="}' 2026-02-19T17:23:31.741 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3de5c323-b138-4e54-b585-94bcdc193a0b -i td/osd-bluefs-volume-ops/2/new.json 2026-02-19T17:23:31.957 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:23:31.968 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-19T17:23:31.969 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQATR5dptEvPKxAAsb4g47IHbUlqU+VG7m0sjw== --osd-uuid 3de5c323-b138-4e54-b585-94bcdc193a0b 2026-02-19T17:23:31.992 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:31.985+0000 7f9a920a1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:31.993 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:31.985+0000 7f9a920a1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:31.994 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:31.989+0000 7f9a920a1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:31.995 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:31.989+0000 7f9a920a1a40 -1 bdev(0x55944c29c400 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-19T17:23:31.995 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:31.989+0000 7f9a920a1a40 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-19T17:23:33.438 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-19T17:23:33.438 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:23:33.439 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-19T17:23:33.439 INFO:tasks.workunit.client.0.trial119.stdout:adding osd2 key to auth repository 2026-02-19T17:23:33.440 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:23:33.726 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:23:33.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-19T17:23:33.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:33.727 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:23:33.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:23:33.728 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:23:33.741 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:33.733+0000 7f88865c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:33.742 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:33.737+0000 7f88865c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:33.743 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:33.737+0000 7f88865c7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:33.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-19T17:23:33.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:33.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:23:33.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:33.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:33.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:33.939 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:33.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:33.939 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:33.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:23:34.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:34.296 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:34.289+0000 7f88865c7a40 -1 Falling back to public interface 2026-02-19T17:23:35.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:35.150 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:35.151 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:23:35.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:23:35.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:35.151 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:23:35.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:35.488 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:35.481+0000 7f88865c7a40 -1 osd.2 0 log_to_monitors true 2026-02-19T17:23:36.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:36.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:36.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:23:36.362 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:23:36.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:36.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:23:36.575 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1413588907,v1:127.0.0.1:6819/1413588907] [v2:127.0.0.1:6820/1413588907,v1:127.0.0.1:6821/1413588907] exists,up 3de5c323-b138-4e54-b585-94bcdc193a0b 2026-02-19T17:23:36.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:36.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:36.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:36.576 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T17:23:36.578 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=94310 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:23:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:23:36.580 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:36.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:23:36.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:23:36.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:23:36.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:23:36.582 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=15212a1a-4893-4b23-9e14-6b681a03a29c 2026-02-19T17:23:36.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 15212a1a-4893-4b23-9e14-6b681a03a29c' 2026-02-19T17:23:36.584 INFO:tasks.workunit.client.0.trial119.stdout:add osd3 15212a1a-4893-4b23-9e14-6b681a03a29c 2026-02-19T17:23:36.584 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:23:36.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAYR5dpQ8EOIxAAsLK7uUCBSwuZsp0JOM5jNg== 2026-02-19T17:23:36.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAYR5dpQ8EOIxAAsLK7uUCBSwuZsp0JOM5jNg=="}' 2026-02-19T17:23:36.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 15212a1a-4893-4b23-9e14-6b681a03a29c -i td/osd-bluefs-volume-ops/3/new.json 2026-02-19T17:23:36.810 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:23:36.819 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-19T17:23:36.820 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAYR5dpQ8EOIxAAsLK7uUCBSwuZsp0JOM5jNg== --osd-uuid 15212a1a-4893-4b23-9e14-6b681a03a29c 2026-02-19T17:23:36.835 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:36.829+0000 7f54e5ce0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:36.837 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:36.829+0000 7f54e5ce0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:36.838 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:36.833+0000 7f54e5ce0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:36.839 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:36.833+0000 7f54e5ce0a40 -1 bdev(0x55e651d08400 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-19T17:23:36.839 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:36.833+0000 7f54e5ce0a40 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-19T17:23:38.273 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-19T17:23:38.274 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:23:38.274 INFO:tasks.workunit.client.0.trial119.stdout:adding osd3 key to auth repository 2026-02-19T17:23:38.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-19T17:23:38.275 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:23:38.566 INFO:tasks.workunit.client.0.trial119.stdout:start osd.3 2026-02-19T17:23:38.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-19T17:23:38.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:23:38.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:23:38.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:23:38.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:23:38.583 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:38.577+0000 7f09911f8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:38.585 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:38.577+0000 7f09911f8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:38.586 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:38.577+0000 7f09911f8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:23:38.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-19T17:23:38.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:23:38.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T17:23:38.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:23:38.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:23:38.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:38.776 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:23:38.776 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:23:38.777 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:38.777 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:23:38.982 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:39.044 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:39.037+0000 7f09911f8a40 -1 Falling back to public interface 2026-02-19T17:23:39.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:39.984 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:23:39.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:39.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:23:39.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:39.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:23:40.123 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:23:40.117+0000 7f09911f8a40 -1 osd.3 0 log_to_monitors true 2026-02-19T17:23:40.189 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:23:41.191 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:23:41.191 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:23:41.192 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:23:41.192 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:23:41.192 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:23:41.192 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:23:41.407 INFO:tasks.workunit.client.0.trial119.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1754510485,v1:127.0.0.1:6827/1754510485] [v2:127.0.0.1:6828/1754510485,v1:127.0.0.1:6829/1754510485] exists,up 15212a1a-4893-4b23-9e14-6b681a03a29c 2026-02-19T17:23:41.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:23:41.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:23:41.408 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:23:41.408 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T17:23:41.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=96642 2026-02-19T17:23:41.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-19T17:23:46.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-19T17:23:46.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-19T17:23:46.672 INFO:tasks.workunit.client.0.trial119.stderr:pool 'foo' already exists 2026-02-19T17:23:46.682 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:23:47.684 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T17:23:47.704 INFO:tasks.workunit.client.0.trial119.stdout:hints = 1 2026-02-19T17:23:47.704 INFO:tasks.workunit.client.0.trial119.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T17:23:47.704 INFO:tasks.workunit.client.0.trial119.stdout:Object prefix: benchmark_data_trial119_97600 2026-02-19T17:23:47.704 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:23:47.704 INFO:tasks.workunit.client.0.trial119.stdout: 0 0 0 0 0 0 - 0 2026-02-19T17:23:48.704 INFO:tasks.workunit.client.0.trial119.stdout: 1 15 10940 10925 42.6725 42.6758 0.00147378 0.00146217 2026-02-19T17:23:49.704 INFO:tasks.workunit.client.0.trial119.stdout: 2 16 21897 21881 42.733 42.7969 0.00129743 0.00146044 2026-02-19T17:23:50.704 INFO:tasks.workunit.client.0.trial119.stdout: 3 16 33152 33136 43.1423 43.9648 0.00155641 0.00144678 2026-02-19T17:23:51.704 INFO:tasks.workunit.client.0.trial119.stdout: 4 16 44263 44247 43.2064 43.4023 0.00127939 0.00144496 2026-02-19T17:23:52.704 INFO:tasks.workunit.client.0.trial119.stdout: 5 16 55408 55392 43.2715 43.5352 0.00100655 0.00144264 2026-02-19T17:23:53.704 INFO:tasks.workunit.client.0.trial119.stdout: 6 16 66374 66358 43.1983 42.8359 0.00138887 0.00144517 2026-02-19T17:23:54.704 INFO:tasks.workunit.client.0.trial119.stdout: 7 16 73613 73597 41.0664 28.2773 0.00242225 0.00152032 2026-02-19T17:23:55.705 INFO:tasks.workunit.client.0.trial119.stdout: 8 15 84859 84844 41.4243 43.9336 0.00143096 0.00150721 2026-02-19T17:23:56.705 INFO:tasks.workunit.client.0.trial119.stdout: 9 16 96296 96280 41.7848 44.6719 0.00171497 0.00149421 2026-02-19T17:23:57.705 INFO:tasks.workunit.client.0.trial119.stdout: 10 15 107539 107524 41.9981 43.9219 0.00125638 0.00148661 2026-02-19T17:23:58.705 INFO:tasks.workunit.client.0.trial119.stdout: 11 16 118768 118752 42.167 43.8594 0.00153096 0.00148066 2026-02-19T17:23:59.705 INFO:tasks.workunit.client.0.trial119.stdout: 12 16 129731 129715 42.2215 42.8242 0.00126186 0.00147706 2026-02-19T17:24:00.705 INFO:tasks.workunit.client.0.trial119.stdout: 13 16 129838 129822 39.0059 0.417969 0.0928165 0.00159717 2026-02-19T17:24:01.705 INFO:tasks.workunit.client.0.trial119.stdout: 14 16 134124 134108 37.4155 16.7422 0.00132312 0.00166891 2026-02-19T17:24:02.705 INFO:tasks.workunit.client.0.trial119.stdout: 15 16 144245 144229 37.5566 39.5352 0.00145328 0.00166264 2026-02-19T17:24:03.705 INFO:tasks.workunit.client.0.trial119.stdout: 16 16 154092 154076 37.6131 38.4648 0.00142133 0.00166012 2026-02-19T17:24:04.705 INFO:tasks.workunit.client.0.trial119.stdout: 17 16 163792 163776 37.6293 37.8906 0.00172932 0.00165941 2026-02-19T17:24:05.706 INFO:tasks.workunit.client.0.trial119.stdout: 18 16 173301 173285 37.6022 37.1445 0.00153875 0.0016606 2026-02-19T17:24:06.706 INFO:tasks.workunit.client.0.trial119.stdout: 19 16 179215 179199 36.8389 23.1016 0.091907 0.00169042 2026-02-19T17:24:07.706 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:24:07.700834+0000 min lat: 0.000430174 max lat: 0.377476 avg lat: 0.00178222 2026-02-19T17:24:07.706 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:24:07.706 INFO:tasks.workunit.client.0.trial119.stdout: 20 16 179334 179318 35.0202 0.464844 0.151379 0.00178222 2026-02-19T17:24:08.706 INFO:tasks.workunit.client.0.trial119.stdout: 21 16 179455 179439 33.3751 0.472656 0.120017 0.00186483 2026-02-19T17:24:09.706 INFO:tasks.workunit.client.0.trial119.stdout: 22 16 185014 184998 32.845 21.7148 0.00131016 0.00190137 2026-02-19T17:24:10.706 INFO:tasks.workunit.client.0.trial119.stdout: 23 16 194555 194539 33.0372 37.2695 0.00242255 0.0018902 2026-02-19T17:24:11.706 INFO:tasks.workunit.client.0.trial119.stdout: 24 16 203949 203933 33.1895 36.6953 0.00127943 0.0018816 2026-02-19T17:24:12.706 INFO:tasks.workunit.client.0.trial119.stdout: 25 16 213296 213280 33.3223 36.5117 0.00157556 0.00187411 2026-02-19T17:24:13.706 INFO:tasks.workunit.client.0.trial119.stdout: 26 16 222645 222629 33.4452 36.5195 0.00176233 0.00186721 2026-02-19T17:24:14.706 INFO:tasks.workunit.client.0.trial119.stdout: 27 15 232101 232086 33.5746 36.9414 0.00215627 0.00186003 2026-02-19T17:24:15.707 INFO:tasks.workunit.client.0.trial119.stdout: 28 16 241464 241448 33.6814 36.5703 0.00189678 0.00185413 2026-02-19T17:24:16.707 INFO:tasks.workunit.client.0.trial119.stdout: 29 16 250763 250747 33.7725 36.3242 0.00211926 0.00184912 2026-02-19T17:24:17.707 INFO:tasks.workunit.client.0.trial119.stdout:Total time run: 30.0012 2026-02-19T17:24:17.707 INFO:tasks.workunit.client.0.trial119.stdout:Total writes made: 259982 2026-02-19T17:24:17.707 INFO:tasks.workunit.client.0.trial119.stdout:Write size: 4096 2026-02-19T17:24:17.707 INFO:tasks.workunit.client.0.trial119.stdout:Object size: 4096 2026-02-19T17:24:17.707 INFO:tasks.workunit.client.0.trial119.stdout:Bandwidth (MB/sec): 33.8505 2026-02-19T17:24:17.707 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Bandwidth: 13.4928 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Max bandwidth (MB/sec): 44.6719 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Min bandwidth (MB/sec): 0.417969 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Average IOPS: 8665 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Stddev IOPS: 3454.16 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Max IOPS: 11436 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Min IOPS: 107 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Average Latency(s): 0.00184488 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Latency(s): 0.00638046 2026-02-19T17:24:17.708 INFO:tasks.workunit.client.0.trial119.stdout:Max latency(s): 0.377476 2026-02-19T17:24:17.709 INFO:tasks.workunit.client.0.trial119.stdout:Min latency(s): 0.000430174 2026-02-19T17:24:17.710 INFO:tasks.workunit.client.0.trial119.stdout:after bench 2026-02-19T17:24:17.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-19T17:24:17.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 89420 2026-02-19T17:24:17.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-19T17:24:18.711 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 89420 2026-02-19T17:24:18.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (89420) - No such process 2026-02-19T17:24:18.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-19T17:24:18.927 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:24:18.937 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 91943 2026-02-19T17:24:18.937 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-19T17:24:19.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 91943 2026-02-19T17:24:19.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (91943) - No such process 2026-02-19T17:24:19.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-19T17:24:20.147 INFO:tasks.workunit.client.0.trial119.stderr:osd.1 is already down. 2026-02-19T17:24:20.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 94310 2026-02-19T17:24:20.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-19T17:24:21.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 94310 2026-02-19T17:24:21.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (94310) - No such process 2026-02-19T17:24:21.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-19T17:24:21.370 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already down. 2026-02-19T17:24:21.380 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 96642 2026-02-19T17:24:21.380 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-19T17:24:22.382 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 96642 2026-02-19T17:24:22.382 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (96642) - No such process 2026-02-19T17:24:22.382 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-19T17:24:22.677 INFO:tasks.workunit.client.0.trial119.stderr:osd.3 is already down. 2026-02-19T17:24:22.687 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:24:26.271 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:24:26.311 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:24:29.831 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:24:29.870 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T17:24:33.447 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:24:33.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:24:37.119 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:24:37.158 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-19T17:24:37.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-19T17:24:37.176 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:24:40.071 INFO:tasks.workunit.client.0.trial119.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-19T17:24:40.071 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-19T17:24:40.071 INFO:tasks.workunit.client.0.trial119.stdout:2 : device size 0x100000000(4 GiB) : using 0xafa13000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xafa13000(2.7 GiB) 2026-02-19T17:24:40.071 INFO:tasks.workunit.client.0.trial119.stdout:Expanding DB/WAL... 2026-02-19T17:24:40.071 INFO:tasks.workunit.client.0.trial119.stdout:0 : nothing to do, skipped 2026-02-19T17:24:40.071 INFO:tasks.workunit.client.0.trial119.stdout:1 : nothing to do, skipped 2026-02-19T17:24:40.072 INFO:tasks.workunit.client.0.trial119.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-19T17:24:40.072 INFO:tasks.workunit.client.0.trial119.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-19T17:24:43.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 11811160064 2026-02-19T17:24:43.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2026-02-19T17:24:43.809 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:24:46.774 INFO:tasks.workunit.client.0.trial119.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-19T17:24:46.775 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-19T17:24:46.775 INFO:tasks.workunit.client.0.trial119.stdout:2 : device size 0x2c0000000(11 GiB) : using 0x26f769000(9.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x26f769000(9.7 GiB) 2026-02-19T17:24:46.775 INFO:tasks.workunit.client.0.trial119.stdout:Expanding DB/WAL... 2026-02-19T17:24:46.775 INFO:tasks.workunit.client.0.trial119.stdout:0 : nothing to do, skipped 2026-02-19T17:24:46.775 INFO:tasks.workunit.client.0.trial119.stdout:1 : nothing to do, skipped 2026-02-19T17:24:46.775 INFO:tasks.workunit.client.0.trial119.stdout:2 : Expanding to 0x2c0000000(11 GiB) 2026-02-19T17:24:46.776 INFO:tasks.workunit.client.0.trial119.stdout:2 : size updated to 0x2c0000000(11 GiB) 2026-02-19T17:24:50.039 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2026-02-19T17:24:50.040 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2026-02-19T17:24:50.058 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:24:52.966 INFO:tasks.workunit.client.0.trial119.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-19T17:24:52.967 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-19T17:24:52.967 INFO:tasks.workunit.client.0.trial119.stdout:2 : device size 0x100020000(4.0 GiB) : using 0xafaa8000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xafaa8000(2.7 GiB) 2026-02-19T17:24:52.967 INFO:tasks.workunit.client.0.trial119.stdout:Expanding DB/WAL... 2026-02-19T17:24:52.967 INFO:tasks.workunit.client.0.trial119.stdout:0 : nothing to do, skipped 2026-02-19T17:24:52.967 INFO:tasks.workunit.client.0.trial119.stdout:1 : nothing to do, skipped 2026-02-19T17:24:52.967 INFO:tasks.workunit.client.0.trial119.stdout:2 : Expanding to 0x100020000(4.0 GiB) 2026-02-19T17:24:52.968 INFO:tasks.workunit.client.0.trial119.stdout:2 : size updated to 0x100020000(4.0 GiB) 2026-02-19T17:24:56.185 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:81: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2026-02-19T17:24:56.186 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:82: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2026-02-19T17:24:56.205 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:24:59.187 INFO:tasks.workunit.client.0.trial119.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-19T17:24:59.187 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-19T17:24:59.187 INFO:tasks.workunit.client.0.trial119.stdout:2 : device size 0xfff00000(4.0 GiB) : using 0xafa77000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xafa77000(2.7 GiB) 2026-02-19T17:24:59.187 INFO:tasks.workunit.client.0.trial119.stdout:Expanding DB/WAL... 2026-02-19T17:24:59.187 INFO:tasks.workunit.client.0.trial119.stdout:0 : nothing to do, skipped 2026-02-19T17:24:59.187 INFO:tasks.workunit.client.0.trial119.stdout:1 : nothing to do, skipped 2026-02-19T17:24:59.188 INFO:tasks.workunit.client.0.trial119.stdout:2 : Expanding to 0xfff00000(4.0 GiB) 2026-02-19T17:24:59.188 INFO:tasks.workunit.client.0.trial119.stdout:2 : size updated to 0xfff00000(4.0 GiB) 2026-02-19T17:25:02.425 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:25:03.315 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:03.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:25:04.275 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:04.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:87: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T17:25:05.199 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:05.237 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:25:06.123 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:06.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-19T17:25:06.180 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:25:06.364 INFO:tasks.workunit.client.0.trial119.stdout:0 : device size 0x20000000(512 MiB) : using 0x1900000(25 MiB) 2026-02-19T17:25:06.364 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x40000000(1 GiB) : using 0x4100000(65 MiB) 2026-02-19T17:25:06.364 INFO:tasks.workunit.client.0.trial119.stdout:2 : device size 0x100000000(4 GiB) : using 0x2fa13000(762 MiB) : bluefs used 0x0(0 B) : non-bluefs used 0x2fa13000(762 MiB) 2026-02-19T17:25:06.543 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:92: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2026-02-19T17:25:06.554 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:25:07.147 INFO:tasks.workunit.client.0.trial119.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-19T17:25:07.155 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:97: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:25:07.967 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:07.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:100: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-19T17:25:08.015 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:25:08.607 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-19T17:25:08.613 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:105: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:25:09.391 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:09.420 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:108: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2026-02-19T17:25:09.437 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:25:10.075 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-19T17:25:10.076 INFO:tasks.workunit.client.0.trial119.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-19T17:25:10.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:114: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T17:25:10.787 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:10.819 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:117: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2026-02-19T17:25:10.833 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:25:10.939 INFO:tasks.workunit.client.0.trial119.stderr:Migrate to WAL device isn't supported. 2026-02-19T17:25:10.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:123: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-19T17:25:10.942 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:126: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:25:11.844 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:11.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:129: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-19T17:25:11.900 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:25:12.451 INFO:tasks.workunit.client.0.trial119.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-19T17:25:12.459 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:25:13.280 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:13.312 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:136: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2026-02-19T17:25:13.329 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:25:13.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:25:14.611 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:25:14.644 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:25:14.644 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:25:14.645 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:14.646 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:25:14.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:25:14.648 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:25:14.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:25:14.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:25:14.649 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T17:25:14.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:25:14.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:25:14.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:25:14.649 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:25:14.669 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:14.659+0000 7ff673da0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:14.671 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:14.659+0000 7ff673da0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:14.672 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:14.663+0000 7ff673da0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:14.853 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:25:15.068 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:15.137 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:15.127+0000 7ff673da0a40 -1 Falling back to public interface 2026-02-19T17:25:16.069 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:16.070 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:16.070 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:25:16.071 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:25:16.071 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:16.071 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:25:16.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:16.955 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:16.943+0000 7ff673da0a40 -1 osd.0 21 log_to_monitors true 2026-02-19T17:25:17.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:17.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:17.281 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:25:17.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:25:17.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:17.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:25:17.496 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 29 up_thru 29 down_at 21 last_clean_interval [5,21) [v2:127.0.0.1:6802/2063984424,v1:127.0.0.1:6803/2063984424] [v2:127.0.0.1:6804/2063984424,v1:127.0.0.1:6805/2063984424] exists,up 35b4d609-ac49-413e-8834-e5803b384135 2026-02-19T17:25:17.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:25:17.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:25:17.497 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:25:17.497 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid0=108253 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T17:25:17.500 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:25:17.501 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:25:17.502 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:25:17.502 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:25:17.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T17:25:17.504 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:25:17.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:25:17.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:25:17.505 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-19T17:25:17.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:25:17.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:25:17.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:25:17.505 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:25:17.519 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:17.511+0000 7f05ff5cea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:17.521 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:17.511+0000 7f05ff5cea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:17.522 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:17.511+0000 7f05ff5cea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:17.711 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:25:17.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:25:17.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:25:17.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:25:17.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:25:17.712 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:17.712 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:25:17.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:25:17.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:17.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:25:17.921 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:17.933 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:17.923+0000 7f05ff5cea40 -1 Falling back to public interface 2026-02-19T17:25:18.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:18.922 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:18.922 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:25:18.923 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:25:18.923 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:18.923 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:25:19.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:19.828 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:19.819+0000 7f05ff5cea40 -1 osd.1 22 log_to_monitors true 2026-02-19T17:25:20.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:20.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:20.139 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:25:20.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:25:20.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:20.140 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:25:20.348 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 33 up_thru 33 down_at 23 last_clean_interval [9,22) [v2:127.0.0.1:6810/3043405833,v1:127.0.0.1:6811/3043405833] [v2:127.0.0.1:6812/3043405833,v1:127.0.0.1:6813/3043405833] exists,up 9d41eda0-56e2-432c-9523-22ae21e660dd 2026-02-19T17:25:20.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:25:20.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:25:20.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:25:20.355 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T17:25:20.355 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid1=109194 2026-02-19T17:25:20.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-19T17:25:20.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:25:20.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:25:20.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:25:20.356 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:25:20.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T17:25:20.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:25:20.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:25:20.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:25:20.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:25:20.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T17:25:20.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T17:25:20.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:25:20.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:25:20.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:25:20.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:25:20.358 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:25:20.359 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:25:20.359 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:25:20.359 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:25:20.359 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:25:20.359 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:20.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:20.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:25:20.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:25:20.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:25:20.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:25:20.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:25:20.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:25:20.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:25:20.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:25:20.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:25:20.361 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T17:25:20.362 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:25:20.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:25:20.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:25:20.364 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-19T17:25:20.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:25:20.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:25:20.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:25:20.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:25:20.376 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:20.367+0000 7f14efecfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:20.378 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:20.367+0000 7f14efecfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:20.378 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:20.367+0000 7f14efecfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:20.559 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:20.560 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:25:20.725 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:20.715+0000 7f14efecfa40 -1 Falling back to public interface 2026-02-19T17:25:20.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:21.776 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:21.777 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:21.777 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:25:21.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:25:21.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:21.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:25:21.989 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:22.409 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:22.399+0000 7f14efecfa40 -1 osd.2 24 log_to_monitors true 2026-02-19T17:25:22.991 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:22.991 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:22.991 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:25:22.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:25:22.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:22.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:25:23.199 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 37 up_thru 37 down_at 25 last_clean_interval [13,24) [v2:127.0.0.1:6818/4214102816,v1:127.0.0.1:6819/4214102816] [v2:127.0.0.1:6820/4214102816,v1:127.0.0.1:6821/4214102816] exists,up 3de5c323-b138-4e54-b585-94bcdc193a0b 2026-02-19T17:25:23.200 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:25:23.200 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:25:23.200 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:25:23.200 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid2=110135 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:149: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:25:23.205 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:25:23.206 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:25:23.207 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T17:25:23.208 INFO:tasks.workunit.client.0.trial119.stdout:start osd.3 2026-02-19T17:25:23.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T17:25:23.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:25:23.209 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-19T17:25:23.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T17:25:23.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:25:23.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:25:23.209 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:25:23.223 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:23.211+0000 7fa50fc44a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:23.224 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:23.215+0000 7fa50fc44a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:23.225 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:23.215+0000 7fa50fc44a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:25:23.416 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T17:25:23.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:25:23.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T17:25:23.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:25:23.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:25:23.417 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:23.417 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:25:23.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:25:23.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:23.418 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:25:23.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:23.765 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:23.755+0000 7fa50fc44a40 -1 Falling back to public interface 2026-02-19T17:25:24.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:24.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:24.627 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:25:24.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:25:24.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:24.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:25:24.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:25:25.619 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:25:25.607+0000 7fa50fc44a40 -1 osd.3 26 log_to_monitors true 2026-02-19T17:25:25.843 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:25:25.843 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:25:25.843 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:25:25.843 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:25:25.843 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:25:25.843 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:25:26.054 INFO:tasks.workunit.client.0.trial119.stdout:osd.3 up in weight 1 up_from 42 up_thru 42 down_at 27 last_clean_interval [17,26) [v2:127.0.0.1:6826/1879998174,v1:127.0.0.1:6827/1879998174] [v2:127.0.0.1:6828/1879998174,v1:127.0.0.1:6829/1879998174] exists,up 15212a1a-4893-4b23-9e14-6b681a03a29c 2026-02-19T17:25:26.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:25:26.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:25:26.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:25:26.055 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T17:25:26.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: osd_pid3=111071 2026-02-19T17:25:26.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:152: TEST_bluestore: wait_for_clean 2026-02-19T17:25:26.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:25:26.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:25:26.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:25:26.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:25:26.057 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:25:26.057 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:25:26.057 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:25:26.058 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:25:26.058 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:25:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:25:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:25:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:25:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:25:26.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:25:26.157 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:25:26.370 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:25:26.371 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:25:26.371 INFO:tasks.workunit.client.0.trial119.stderr:2 2026-02-19T17:25:26.371 INFO:tasks.workunit.client.0.trial119.stderr:3' 2026-02-19T17:25:26.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:25:26.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:25:26.372 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:25:26.450 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051588 2026-02-19T17:25:26.450 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051588 2026-02-19T17:25:26.450 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588' 2026-02-19T17:25:26.450 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:25:26.450 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:25:26.532 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920772 2026-02-19T17:25:26.533 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920772 2026-02-19T17:25:26.533 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588 1-141733920772' 2026-02-19T17:25:26.533 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:25:26.533 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:25:26.609 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-19T17:25:26.609 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-19T17:25:26.609 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588 1-141733920772 2-158913789955' 2026-02-19T17:25:26.610 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:25:26.610 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-19T17:25:26.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626435 2026-02-19T17:25:26.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626435 2026-02-19T17:25:26.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588 1-141733920772 2-158913789955 3-180388626435' 2026-02-19T17:25:26.690 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:25:26.691 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051588 2026-02-19T17:25:26.691 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:25:26.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:25:26.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051588 2026-02-19T17:25:26.693 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:25:26.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051588 2026-02-19T17:25:26.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051588' 2026-02-19T17:25:26.695 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 124554051588 2026-02-19T17:25:26.695 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:25:26.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051588 2026-02-19T17:25:26.903 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:25:27.904 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:25:27.905 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:25:28.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051588 2026-02-19T17:25:28.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:25:29.121 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T17:25:29.121 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:25:29.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051589 -lt 124554051588 2026-02-19T17:25:29.332 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:25:29.333 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-141733920772 2026-02-19T17:25:29.333 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:25:29.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:25:29.335 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-141733920772 2026-02-19T17:25:29.335 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:25:29.336 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920772 2026-02-19T17:25:29.337 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 141733920772' 2026-02-19T17:25:29.337 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 141733920772 2026-02-19T17:25:29.337 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:25:29.551 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-19T17:25:29.551 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:25:29.552 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789955 2026-02-19T17:25:29.552 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:25:29.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:25:29.554 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-19T17:25:29.554 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:25:29.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-19T17:25:29.555 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-19T17:25:29.556 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 158913789955 2026-02-19T17:25:29.556 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:25:29.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789956 -lt 158913789955 2026-02-19T17:25:29.774 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:25:29.775 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-180388626435 2026-02-19T17:25:29.775 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:25:29.776 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-19T17:25:29.777 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-180388626435 2026-02-19T17:25:29.777 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:25:29.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626435 2026-02-19T17:25:29.779 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 180388626435' 2026-02-19T17:25:29.779 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.3 seq 180388626435 2026-02-19T17:25:29.780 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-19T17:25:29.988 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-19T17:25:29.989 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:25:29.989 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:25:29.989 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:25:30.269 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T17:25:30.269 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:25:30.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:25:30.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:25:30.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:25:30.270 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:25:30.271 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:25:30.271 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:25:30.484 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T17:25:30.485 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:25:30.486 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:25:30.486 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:25:30.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T17:25:30.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:25:30.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:25:30.775 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:155: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T17:25:30.793 INFO:tasks.workunit.client.0.trial119.stdout:hints = 1 2026-02-19T17:25:30.793 INFO:tasks.workunit.client.0.trial119.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T17:25:30.793 INFO:tasks.workunit.client.0.trial119.stdout:Object prefix: benchmark_data_trial119_112412 2026-02-19T17:25:30.793 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:25:30.793 INFO:tasks.workunit.client.0.trial119.stdout: 0 0 0 0 0 0 - 0 2026-02-19T17:25:31.793 INFO:tasks.workunit.client.0.trial119.stdout: 1 16 10510 10494 40.9887 40.9922 0.00235343 0.0015217 2026-02-19T17:25:32.793 INFO:tasks.workunit.client.0.trial119.stdout: 2 15 20889 20874 40.7662 40.5469 0.00142336 0.00153096 2026-02-19T17:25:33.793 INFO:tasks.workunit.client.0.trial119.stdout: 3 16 30757 30741 40.0241 38.543 0.00182875 0.00155958 2026-02-19T17:25:34.793 INFO:tasks.workunit.client.0.trial119.stdout: 4 16 40401 40385 39.4354 37.6719 0.00147348 0.00158298 2026-02-19T17:25:35.794 INFO:tasks.workunit.client.0.trial119.stdout: 5 16 50071 50055 39.1024 37.7734 0.00194545 0.00159654 2026-02-19T17:25:36.793 INFO:tasks.workunit.client.0.trial119.stdout: 6 16 59631 59615 38.8089 37.3438 0.00129417 0.00160867 2026-02-19T17:25:37.793 INFO:tasks.workunit.client.0.trial119.stdout: 7 16 69371 69355 38.6996 38.0469 0.00287322 0.00161328 2026-02-19T17:25:38.794 INFO:tasks.workunit.client.0.trial119.stdout: 8 16 78928 78912 38.5283 37.332 0.00110618 0.0016205 2026-02-19T17:25:39.794 INFO:tasks.workunit.client.0.trial119.stdout: 9 16 88295 88279 38.3126 36.5898 0.00135923 0.00162964 2026-02-19T17:25:40.794 INFO:tasks.workunit.client.0.trial119.stdout: 10 16 98016 98000 38.2783 37.9727 0.00122189 0.00163115 2026-02-19T17:25:41.794 INFO:tasks.workunit.client.0.trial119.stdout: 11 16 107648 107632 38.2187 37.625 0.00158915 0.00163371 2026-02-19T17:25:42.794 INFO:tasks.workunit.client.0.trial119.stdout: 12 15 117055 117040 38.096 36.75 0.00146505 0.00163898 2026-02-19T17:25:43.794 INFO:tasks.workunit.client.0.trial119.stdout: 13 16 126608 126592 38.0355 37.3125 0.00132024 0.00164159 2026-02-19T17:25:44.794 INFO:tasks.workunit.client.0.trial119.stdout: 14 16 136226 136210 38.0021 37.5703 0.00185677 0.00164304 2026-02-19T17:25:45.794 INFO:tasks.workunit.client.0.trial119.stdout: 15 16 146043 146027 38.0249 38.3477 0.00136924 0.00164204 2026-02-19T17:25:46.794 INFO:tasks.workunit.client.0.trial119.stdout: 16 16 155486 155470 37.9536 36.8867 0.00181102 0.00164516 2026-02-19T17:25:47.794 INFO:tasks.workunit.client.0.trial119.stdout: 17 16 165132 165116 37.9373 37.6797 0.00155023 0.00164586 2026-02-19T17:25:48.794 INFO:tasks.workunit.client.0.trial119.stdout: 18 16 174373 174357 37.835 36.0977 0.0307609 0.00164632 2026-02-19T17:25:49.795 INFO:tasks.workunit.client.0.trial119.stdout: 19 16 174707 174691 35.9123 1.30469 0.0288362 0.00173638 2026-02-19T17:25:50.795 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:25:50.788469+0000 min lat: 0.000447917 max lat: 0.375875 avg lat: 0.00181936 2026-02-19T17:25:50.795 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:25:50.795 INFO:tasks.workunit.client.0.trial119.stdout: 20 16 174872 174856 34.1489 0.644531 0.375695 0.00181936 2026-02-19T17:25:51.795 INFO:tasks.workunit.client.0.trial119.stdout: 21 16 175007 174991 32.5479 0.527344 0.0505842 0.0019098 2026-02-19T17:25:52.795 INFO:tasks.workunit.client.0.trial119.stdout: 22 16 175144 175128 31.0928 0.535156 0.0515724 0.00200228 2026-02-19T17:25:53.795 INFO:tasks.workunit.client.0.trial119.stdout: 23 15 181115 181100 30.7551 23.3281 0.00227833 0.00203062 2026-02-19T17:25:54.795 INFO:tasks.workunit.client.0.trial119.stdout: 24 16 190763 190747 31.0437 37.6836 0.00180753 0.00201171 2026-02-19T17:25:55.795 INFO:tasks.workunit.client.0.trial119.stdout: 25 16 200419 200403 31.3105 37.7188 0.00180214 0.00199456 2026-02-19T17:25:56.795 INFO:tasks.workunit.client.0.trial119.stdout: 26 16 210168 210152 31.5709 38.082 0.00153666 0.00197809 2026-02-19T17:25:57.795 INFO:tasks.workunit.client.0.trial119.stdout: 27 16 219875 219859 31.8058 37.918 0.00174754 0.00196347 2026-02-19T17:25:58.795 INFO:tasks.workunit.client.0.trial119.stdout: 28 16 224083 224067 31.2569 16.4375 0.0237815 0.00199529 2026-02-19T17:25:59.795 INFO:tasks.workunit.client.0.trial119.stdout: 29 16 224186 224170 30.193 0.402344 0.195284 0.00206321 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Total time run: 30.001 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Total writes made: 227844 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Write size: 4096 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Object size: 4096 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Bandwidth (MB/sec): 29.6662 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Bandwidth: 14.5203 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Max bandwidth (MB/sec): 40.9922 2026-02-19T17:26:00.796 INFO:tasks.workunit.client.0.trial119.stdout:Min bandwidth (MB/sec): 0.402344 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Average IOPS: 7594 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Stddev IOPS: 3717.2 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Max IOPS: 10494 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Min IOPS: 103 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Average Latency(s): 0.00210524 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Latency(s): 0.00782813 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Max latency(s): 0.375875 2026-02-19T17:26:00.797 INFO:tasks.workunit.client.0.trial119.stdout:Min latency(s): 0.000447917 2026-02-19T17:26:00.799 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 108253 2026-02-19T17:26:00.799 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2026-02-19T17:26:01.800 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 108253 2026-02-19T17:26:01.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (108253) - No such process 2026-02-19T17:26:01.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 0 2026-02-19T17:26:02.009 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:26:02.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 109194 2026-02-19T17:26:02.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2026-02-19T17:26:03.021 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 109194 2026-02-19T17:26:03.021 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (109194) - No such process 2026-02-19T17:26:03.021 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 1 2026-02-19T17:26:03.233 INFO:tasks.workunit.client.0.trial119.stderr:osd.1 is already down. 2026-02-19T17:26:03.242 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 110135 2026-02-19T17:26:03.242 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2026-02-19T17:26:04.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 110135 2026-02-19T17:26:04.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (110135) - No such process 2026-02-19T17:26:04.244 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 2 2026-02-19T17:26:04.452 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already down. 2026-02-19T17:26:04.462 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 111071 2026-02-19T17:26:04.462 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: sleep 1 2026-02-19T17:26:05.464 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 111071 2026-02-19T17:26:05.464 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 164: kill: (111071) - No such process 2026-02-19T17:26:05.464 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:165: TEST_bluestore: ceph osd down 3 2026-02-19T17:26:05.721 INFO:tasks.workunit.client.0.trial119.stderr:osd.3 is already down. 2026-02-19T17:26:05.730 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:26:08.820 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:08.861 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:170: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2026-02-19T17:26:09.179 INFO:tasks.workunit.client.0.trial119.stderr:512+0 records in 2026-02-19T17:26:09.179 INFO:tasks.workunit.client.0.trial119.stderr:512+0 records out 2026-02-19T17:26:09.179 INFO:tasks.workunit.client.0.trial119.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.317484 s, 1.7 GB/s 2026-02-19T17:26:09.179 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:171: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2026-02-19T17:26:09.197 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:12.088 INFO:tasks.workunit.client.0.trial119.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2026-02-19T17:26:12.110 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:175: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:26:15.252 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:15.303 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:26:18.728 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:18.778 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:180: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2026-02-19T17:26:19.400 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records in 2026-02-19T17:26:19.400 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records out 2026-02-19T17:26:19.400 INFO:tasks.workunit.client.0.trial119.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.621235 s, 1.7 GB/s 2026-02-19T17:26:19.401 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:181: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2026-02-19T17:26:19.417 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:22.912 INFO:tasks.workunit.client.0.trial119.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2026-02-19T17:26:22.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:185: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2026-02-19T17:26:22.952 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:25.782 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:190: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:26:29.264 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:29.313 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T17:26:32.185 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:32.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:195: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2026-02-19T17:26:32.239 INFO:tasks.workunit.client.0.trial119.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-19T17:26:32.239 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:34.420 INFO:tasks.workunit.client.0.trial119.stdout:DB device added 2026-02-19T17:26:34.436 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:198: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2026-02-19T17:26:34.452 INFO:tasks.workunit.client.0.trial119.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-19T17:26:34.452 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:36.732 INFO:tasks.workunit.client.0.trial119.stdout:WAL device added 2026-02-19T17:26:36.748 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:201: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2026-02-19T17:26:36.762 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:39.557 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:206: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T17:26:42.580 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:42.628 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:26:45.669 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:45.704 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:211: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2026-02-19T17:26:45.723 INFO:tasks.workunit.client.0.trial119.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-19T17:26:45.723 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:48.161 INFO:tasks.workunit.client.0.trial119.stdout:WAL device added 2026-02-19T17:26:48.181 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:214: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-19T17:26:48.194 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:26:51.169 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2026-02-19T17:26:51.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:26:54.189 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:26:54.228 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:26:54.229 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:26:54.229 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:26:54.229 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:26:54.229 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:26:54.229 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:26:54.230 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:26:54.231 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:26:54.231 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:26:54.231 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T17:26:54.232 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:26:54.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:26:54.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:26:54.233 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:26:54.250 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:26:54.241+0000 7fc2f65bda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:26:54.251 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:26:54.241+0000 7fc2f65bda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:26:54.252 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:26:54.241+0000 7fc2f65bda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:26:54.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:26:54.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:26:54.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:26:54.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:26:54.445 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:26:54.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:26:54.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:26:54.446 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:26:54.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:26:54.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:26:54.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:26:54.750 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:26:54.741+0000 7fc2f65bda40 -1 Falling back to public interface 2026-02-19T17:26:55.663 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:26:55.664 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:26:55.664 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:26:55.664 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:26:55.664 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:26:55.664 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:26:55.877 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:26:56.879 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:26:56.879 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:26:56.879 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:26:56.879 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:26:56.879 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:26:56.879 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:26:57.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:26:58.094 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:26:58.094 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:26:58.094 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:26:58.095 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:26:58.095 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:26:58.095 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:26:58.306 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:26:59.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:26:59.308 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:26:59.309 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:26:59.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:26:59.309 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:26:59.310 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:26:59.519 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:00.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:00.521 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:00.522 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:27:00.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:27:00.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:00.522 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:27:00.735 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:01.122 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:01.113+0000 7fc2f65bda40 -1 osd.0 45 log_to_monitors true 2026-02-19T17:27:01.736 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:01.736 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:01.737 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:27:01.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:27:01.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:01.737 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:27:01.946 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 53 up_thru 53 down_at 45 last_clean_interval [29,45) [v2:127.0.0.1:6802/1326160627,v1:127.0.0.1:6803/1326160627] [v2:127.0.0.1:6804/1326160627,v1:127.0.0.1:6805/1326160627] exists,up 35b4d609-ac49-413e-8834-e5803b384135 2026-02-19T17:27:01.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:27:01.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:27:01.947 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:27:01.947 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:27:01.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid0=118562 2026-02-19T17:27:01.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-19T17:27:01.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:27:01.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:27:01.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:27:01.951 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:27:01.952 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:27:01.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:27:01.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:27:01.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:27:01.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:27:01.953 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T17:27:01.953 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:27:01.954 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:27:01.955 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:27:01.955 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-19T17:27:01.955 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:27:01.955 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:27:01.955 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:27:01.955 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:27:01.974 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:01.965+0000 7f45e2d6aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:01.976 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:01.965+0000 7f45e2d6aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:01.977 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:01.969+0000 7f45e2d6aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:02.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:27:02.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:27:02.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:27:02.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:27:02.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:27:02.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:02.159 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:27:02.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:27:02.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:02.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:02.378 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:02.438 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:02.429+0000 7f45e2d6aa40 -1 Falling back to public interface 2026-02-19T17:27:03.380 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:03.380 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:03.381 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:27:03.381 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:27:03.382 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:03.382 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:03.591 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:04.592 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:04.592 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:04.593 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:27:04.593 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:27:04.593 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:04.593 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:04.803 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:05.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:05.805 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:05.806 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:27:05.806 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:27:05.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:05.807 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:06.016 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:07.017 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:07.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:07.018 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:27:07.018 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:27:07.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:07.019 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:07.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:08.253 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:08.254 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:27:08.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:08.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:27:08.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:08.254 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:08.465 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:09.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:09.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:09.467 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:27:09.467 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:27:09.468 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:09.468 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:09.517 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:09.509+0000 7f45e2d6aa40 -1 osd.1 46 log_to_monitors true 2026-02-19T17:27:09.685 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:10.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:10.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:10.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T17:27:10.686 INFO:tasks.workunit.client.0.trial119.stdout:7 2026-02-19T17:27:10.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:10.686 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:27:10.903 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 56 up_thru 56 down_at 47 last_clean_interval [33,46) [v2:127.0.0.1:6810/1740905398,v1:127.0.0.1:6811/1740905398] [v2:127.0.0.1:6812/1740905398,v1:127.0.0.1:6813/1740905398] exists,up 9d41eda0-56e2-432c-9523-22ae21e660dd 2026-02-19T17:27:10.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:27:10.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:27:10.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:27:10.909 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T17:27:10.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid1=119608 2026-02-19T17:27:10.909 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-19T17:27:10.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:27:10.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:27:10.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:27:10.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:27:10.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T17:27:10.910 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:27:10.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:27:10.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:27:10.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:27:10.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T17:27:10.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T17:27:10.911 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:27:10.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:27:10.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:27:10.912 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:27:10.912 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:27:10.912 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:27:10.912 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:27:10.912 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:27:10.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:27:10.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:27:10.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T17:27:10.914 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:27:10.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:27:10.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:27:10.916 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-19T17:27:10.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:27:10.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:27:10.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:27:10.916 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:27:10.926 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:10.917+0000 7ff1481fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:10.928 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:10.917+0000 7ff1481fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:10.929 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:10.921+0000 7ff1481fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:11.119 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:27:11.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:27:11.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:27:11.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:27:11.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:27:11.120 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:11.121 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:27:11.121 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:27:11.121 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:11.121 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:27:11.327 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:11.486 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:11.477+0000 7ff1481fba40 -1 Falling back to public interface 2026-02-19T17:27:12.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:12.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:12.329 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:27:12.329 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:27:12.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:12.330 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:27:12.547 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:13.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:13.549 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:13.549 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:27:13.550 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:27:13.550 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:13.550 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:27:13.761 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:14.763 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:14.763 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:14.764 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:27:14.764 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:27:14.764 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:14.764 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:27:14.976 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:15.977 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:15.978 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:15.978 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:27:15.979 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:27:15.979 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:15.979 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:27:16.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:17.196 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:17.196 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:17.197 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:27:17.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:27:17.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:17.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:27:17.402 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:17.624 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:17.612+0000 7ff1481fba40 -1 osd.2 49 log_to_monitors true 2026-02-19T17:27:18.403 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:18.404 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:18.404 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:27:18.405 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:27:18.405 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:18.405 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:27:18.617 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 59 up_thru 59 down_at 49 last_clean_interval [37,49) [v2:127.0.0.1:6818/2854366650,v1:127.0.0.1:6819/2854366650] [v2:127.0.0.1:6820/2854366650,v1:127.0.0.1:6821/2854366650] exists,up 3de5c323-b138-4e54-b585-94bcdc193a0b 2026-02-19T17:27:18.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:27:18.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:27:18.618 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:27:18.618 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T17:27:18.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid2=120679 2026-02-19T17:27:18.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:227: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-19T17:27:18.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:27:18.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:27:18.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T17:27:18.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:27:18.622 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:27:18.623 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:27:18.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:27:18.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:27:18.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:27:18.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:27:18.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T17:27:18.625 INFO:tasks.workunit.client.0.trial119.stdout:start osd.3 2026-02-19T17:27:18.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T17:27:18.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:27:18.626 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-19T17:27:18.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T17:27:18.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:27:18.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:27:18.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:27:18.642 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:18.632+0000 7f2b80be8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:18.645 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:18.636+0000 7f2b80be8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:18.646 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:18.636+0000 7f2b80be8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:27:18.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T17:27:18.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:27:18.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T17:27:18.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:27:18.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:27:18.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:18.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:27:18.842 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:27:18.842 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:18.843 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:27:19.051 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:19.102 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:19.092+0000 7f2b80be8a40 -1 Falling back to public interface 2026-02-19T17:27:20.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:20.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:20.053 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:27:20.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:27:20.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:20.054 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:27:20.259 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:21.261 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:21.261 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:21.261 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:27:21.262 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:27:21.262 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:21.262 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:27:21.471 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:22.473 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:22.473 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:22.473 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:27:22.474 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:27:22.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:22.475 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:27:22.678 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:23.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:23.679 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:23.679 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:27:23.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:27:23.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:23.680 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:27:23.888 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:24.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:24.890 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:24.891 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:27:24.891 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:27:24.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:24.892 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:27:25.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:27:25.453 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:27:25.444+0000 7f2b80be8a40 -1 osd.3 50 log_to_monitors true 2026-02-19T17:27:26.101 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:27:26.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:27:26.102 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:27:26.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:27:26.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:27:26.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:27:26.313 INFO:tasks.workunit.client.0.trial119.stdout:osd.3 up in weight 1 up_from 63 up_thru 63 down_at 51 last_clean_interval [42,50) [v2:127.0.0.1:6826/1071989962,v1:127.0.0.1:6827/1071989962] [v2:127.0.0.1:6828/1071989962,v1:127.0.0.1:6829/1071989962] exists,up 15212a1a-4893-4b23-9e14-6b681a03a29c 2026-02-19T17:27:26.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:27:26.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:27:26.314 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:27:26.314 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T17:27:26.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: osd_pid3=121725 2026-02-19T17:27:26.315 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:231: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T17:27:26.332 INFO:tasks.workunit.client.0.trial119.stdout:hints = 1 2026-02-19T17:27:26.332 INFO:tasks.workunit.client.0.trial119.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T17:27:26.332 INFO:tasks.workunit.client.0.trial119.stdout:Object prefix: benchmark_data_trial119_122751 2026-02-19T17:27:26.332 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:27:26.332 INFO:tasks.workunit.client.0.trial119.stdout: 0 0 0 0 0 0 - 0 2026-02-19T17:27:27.332 INFO:tasks.workunit.client.0.trial119.stdout: 1 15 10896 10881 42.4991 42.5039 0.000955285 0.00146824 2026-02-19T17:27:28.332 INFO:tasks.workunit.client.0.trial119.stdout: 2 16 21634 21618 42.2177 41.9414 0.002104 0.00147825 2026-02-19T17:27:29.332 INFO:tasks.workunit.client.0.trial119.stdout: 3 16 30684 30668 39.9282 35.3516 0.00156756 0.00156329 2026-02-19T17:27:30.332 INFO:tasks.workunit.client.0.trial119.stdout: 4 16 41136 41120 40.1525 40.8281 0.00132041 0.00155487 2026-02-19T17:27:31.333 INFO:tasks.workunit.client.0.trial119.stdout: 5 16 51875 51859 40.5112 41.9492 0.000650452 0.00153949 2026-02-19T17:27:32.333 INFO:tasks.workunit.client.0.trial119.stdout: 6 16 62365 62349 40.5883 40.9766 0.00107931 0.00153815 2026-02-19T17:27:33.333 INFO:tasks.workunit.client.0.trial119.stdout: 7 16 72980 72964 40.7131 41.4648 0.00111063 0.00153345 2026-02-19T17:27:34.333 INFO:tasks.workunit.client.0.trial119.stdout: 8 16 79659 79643 38.8849 26.0898 0.175565 0.00159652 2026-02-19T17:27:35.333 INFO:tasks.workunit.client.0.trial119.stdout: 9 16 82121 82105 35.6329 9.61719 0.00201471 0.00175233 2026-02-19T17:27:36.333 INFO:tasks.workunit.client.0.trial119.stdout: 10 16 92889 92873 36.2755 42.0625 0.00118174 0.0017213 2026-02-19T17:27:37.333 INFO:tasks.workunit.client.0.trial119.stdout: 11 16 103368 103352 36.6987 40.9336 0.0023282 0.00170149 2026-02-19T17:27:38.333 INFO:tasks.workunit.client.0.trial119.stdout: 12 16 113414 113398 36.9103 39.2422 0.00255174 0.00169164 2026-02-19T17:27:39.333 INFO:tasks.workunit.client.0.trial119.stdout: 13 16 123357 123341 37.0585 38.8398 0.00133769 0.00168493 2026-02-19T17:27:40.334 INFO:tasks.workunit.client.0.trial119.stdout: 14 16 133218 133202 37.1627 38.5195 0.00123715 0.00168021 2026-02-19T17:27:41.333 INFO:tasks.workunit.client.0.trial119.stdout: 15 16 143241 143225 37.2951 39.1523 0.00107828 0.00167424 2026-02-19T17:27:42.334 INFO:tasks.workunit.client.0.trial119.stdout: 16 16 153278 153262 37.4144 39.207 0.00232678 0.00166892 2026-02-19T17:27:43.334 INFO:tasks.workunit.client.0.trial119.stdout: 17 16 163191 163175 37.4912 38.7227 0.00117579 0.00166551 2026-02-19T17:27:44.333 INFO:tasks.workunit.client.0.trial119.stdout: 18 16 173201 173185 37.5805 39.1016 0.00148033 0.00166151 2026-02-19T17:27:45.334 INFO:tasks.workunit.client.0.trial119.stdout: 19 16 182239 182223 37.4606 35.3047 0.0642499 0.00166413 2026-02-19T17:27:46.334 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:27:46.326412+0000 min lat: 0.00048143 max lat: 0.254553 avg lat: 0.00174938 2026-02-19T17:27:46.334 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:27:46.334 INFO:tasks.workunit.client.0.trial119.stdout: 20 16 182382 182366 35.6155 0.558594 0.116358 0.00174938 2026-02-19T17:27:47.334 INFO:tasks.workunit.client.0.trial119.stdout: 21 15 189255 189240 35.198 26.8516 0.00128821 0.00177414 2026-02-19T17:27:48.334 INFO:tasks.workunit.client.0.trial119.stdout: 22 16 198977 198961 35.324 37.9727 0.00201814 0.0017678 2026-02-19T17:27:49.335 INFO:tasks.workunit.client.0.trial119.stdout: 23 16 208901 208885 35.4735 38.7656 0.00106582 0.00176033 2026-02-19T17:27:50.334 INFO:tasks.workunit.client.0.trial119.stdout: 24 16 218866 218850 35.6173 38.9258 0.00160268 0.00175323 2026-02-19T17:27:51.334 INFO:tasks.workunit.client.0.trial119.stdout: 25 16 228908 228892 35.7615 39.2266 0.00154728 0.00174614 2026-02-19T17:27:52.334 INFO:tasks.workunit.client.0.trial119.stdout: 26 16 231952 231936 34.8434 11.8906 0.0867377 0.00178389 2026-02-19T17:27:53.335 INFO:tasks.workunit.client.0.trial119.stdout: 27 16 232076 232060 33.5708 0.484375 0.0686185 0.00185313 2026-02-19T17:27:54.334 INFO:tasks.workunit.client.0.trial119.stdout: 28 16 237318 237302 33.1031 20.4766 0.00130549 0.00188651 2026-02-19T17:27:55.334 INFO:tasks.workunit.client.0.trial119.stdout: 29 16 247246 247230 33.2988 38.7812 0.00141383 0.00187541 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Total time run: 30.0014 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Total writes made: 256905 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Write size: 4096 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Object size: 4096 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Bandwidth (MB/sec): 33.4496 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Bandwidth: 12.4783 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Max bandwidth (MB/sec): 42.5039 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Min bandwidth (MB/sec): 0.484375 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Average IOPS: 8563 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Stddev IOPS: 3194.45 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Max IOPS: 10881 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Min IOPS: 124 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Average Latency(s): 0.00186696 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Latency(s): 0.00615693 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Max latency(s): 0.254553 2026-02-19T17:27:56.335 INFO:tasks.workunit.client.0.trial119.stdout:Min latency(s): 0.00048143 2026-02-19T17:27:56.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 118562 2026-02-19T17:27:56.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2026-02-19T17:27:57.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 118562 2026-02-19T17:27:57.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (118562) - No such process 2026-02-19T17:27:57.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 0 2026-02-19T17:27:57.556 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:27:57.566 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 119608 2026-02-19T17:27:57.566 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2026-02-19T17:27:58.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 119608 2026-02-19T17:27:58.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (119608) - No such process 2026-02-19T17:27:58.567 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 1 2026-02-19T17:27:58.775 INFO:tasks.workunit.client.0.trial119.stderr:osd.1 is already down. 2026-02-19T17:27:58.785 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 120679 2026-02-19T17:27:58.785 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-19T17:27:59.786 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 120679 2026-02-19T17:27:59.786 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-19T17:28:00.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 120679 2026-02-19T17:28:00.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (120679) - No such process 2026-02-19T17:28:00.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 2 2026-02-19T17:28:01.000 INFO:tasks.workunit.client.0.trial119.stderr:osd.2 is already down. 2026-02-19T17:28:01.010 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 121725 2026-02-19T17:28:01.010 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: sleep 1 2026-02-19T17:28:02.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 121725 2026-02-19T17:28:02.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 240: kill: (121725) - No such process 2026-02-19T17:28:02.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:241: TEST_bluestore: ceph osd down 3 2026-02-19T17:28:02.274 INFO:tasks.workunit.client.0.trial119.stderr:osd.3 is already down. 2026-02-19T17:28:02.284 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:28:06.646 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:06.713 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:246: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2026-02-19T17:28:07.359 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records in 2026-02-19T17:28:07.359 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records out 2026-02-19T17:28:07.359 INFO:tasks.workunit.client.0.trial119.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.644772 s, 1.7 GB/s 2026-02-19T17:28:07.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:247: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2026-02-19T17:28:07.376 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:28:13.350 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-19T17:28:13.350 INFO:tasks.workunit.client.0.trial119.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2026-02-19T17:28:13.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:252: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:28:17.765 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:17.821 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:256: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2026-02-19T17:28:18.147 INFO:tasks.workunit.client.0.trial119.stderr:512+0 records in 2026-02-19T17:28:18.147 INFO:tasks.workunit.client.0.trial119.stderr:512+0 records out 2026-02-19T17:28:18.147 INFO:tasks.workunit.client.0.trial119.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.32481 s, 1.7 GB/s 2026-02-19T17:28:18.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:257: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2026-02-19T17:28:18.164 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:28:22.545 INFO:tasks.workunit.client.0.trial119.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-19T17:28:22.546 INFO:tasks.workunit.client.0.trial119.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2026-02-19T17:28:22.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2026-02-19T17:28:22.647 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:263: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:28:27.042 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:27.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:28:31.518 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:31.578 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:268: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2026-02-19T17:28:32.208 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records in 2026-02-19T17:28:32.208 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records out 2026-02-19T17:28:32.208 INFO:tasks.workunit.client.0.trial119.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.628882 s, 1.7 GB/s 2026-02-19T17:28:32.208 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:269: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2026-02-19T17:28:32.226 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:28:36.918 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-19T17:28:36.918 INFO:tasks.workunit.client.0.trial119.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2026-02-19T17:28:36.918 INFO:tasks.workunit.client.0.trial119.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2026-02-19T17:28:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2026-02-19T17:28:37.076 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:28:41.358 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:41.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:279: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-19T17:28:41.425 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:28:45.186 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-19T17:28:45.218 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2026-02-19T17:28:45.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:286: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-19T17:28:49.526 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:49.580 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:289: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2026-02-19T17:28:54.366 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:54.432 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:292: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-19T17:28:55.071 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records in 2026-02-19T17:28:55.071 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records out 2026-02-19T17:28:55.071 INFO:tasks.workunit.client.0.trial119.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.638911 s, 1.7 GB/s 2026-02-19T17:28:55.071 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:293: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-19T17:28:55.088 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:28:55.202 INFO:tasks.workunit.client.0.trial119.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2026-02-19T17:28:55.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:299: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-19T17:28:55.204 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:302: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T17:28:59.810 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:28:59.868 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-19T17:29:01.238 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records in 2026-02-19T17:29:01.238 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records out 2026-02-19T17:29:01.238 INFO:tasks.workunit.client.0.trial119.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.21644 s, 883 MB/s 2026-02-19T17:29:01.238 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:307: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-19T17:29:01.251 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:29:05.458 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-19T17:29:05.458 INFO:tasks.workunit.client.0.trial119.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-19T17:29:05.458 INFO:tasks.workunit.client.0.trial119.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2026-02-19T17:29:05.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:314: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-19T17:29:09.966 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:29:10.022 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2026-02-19T17:29:10.650 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records in 2026-02-19T17:29:10.650 INFO:tasks.workunit.client.0.trial119.stderr:1024+0 records out 2026-02-19T17:29:10.651 INFO:tasks.workunit.client.0.trial119.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.627206 s, 1.7 GB/s 2026-02-19T17:29:10.651 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:319: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2026-02-19T17:29:10.667 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:29:14.926 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2026-02-19T17:29:14.926 INFO:tasks.workunit.client.0.trial119.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-19T17:29:14.927 INFO:tasks.workunit.client.0.trial119.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2026-02-19T17:29:14.960 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-19T17:29:18.878 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:29:18.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:29:18.933 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:29:18.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:29:18.935 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:29:18.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:29:18.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:29:18.936 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T17:29:18.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:29:18.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:29:18.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:29:18.937 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:29:18.955 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:18.942+0000 7f2204ed4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:18.957 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:18.942+0000 7f2204ed4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:18.958 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:18.946+0000 7f2204ed4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:19.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:29:19.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:29:19.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:29:19.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:29:19.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:29:19.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:19.148 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:29:19.148 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:29:19.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:19.149 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:19.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:19.484 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:19.470+0000 7f2204ed4a40 -1 Falling back to public interface 2026-02-19T17:29:20.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:20.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:20.362 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:29:20.363 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:29:20.363 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:20.363 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:20.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:21.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:21.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:21.575 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:29:21.576 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:29:21.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:21.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:21.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:22.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:22.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:22.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:29:22.789 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:29:22.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:22.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:22.998 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:23.999 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:24.000 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:24.000 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:29:24.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:29:24.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:24.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:24.216 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:25.218 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:25.219 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:25.219 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:29:25.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:29:25.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:25.220 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:25.427 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:26.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:26.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:26.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:29:26.429 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:29:26.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:26.429 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:26.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:27.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:27.641 INFO:tasks.workunit.client.0.trial119.stdout:7 2026-02-19T17:29:27.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:27.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T17:29:27.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:27.642 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:27.864 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:27.982 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:27.966+0000 7f2204ed4a40 -1 osd.0 65 log_to_monitors true 2026-02-19T17:29:28.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:28.866 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:28.866 INFO:tasks.workunit.client.0.trial119.stdout:8 2026-02-19T17:29:28.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T17:29:28.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:28.867 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:29:29.075 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 73 up_thru 73 down_at 65 last_clean_interval [53,65) [v2:127.0.0.1:6802/685329546,v1:127.0.0.1:6803/685329546] [v2:127.0.0.1:6804/685329546,v1:127.0.0.1:6805/685329546] exists,up 35b4d609-ac49-413e-8834-e5803b384135 2026-02-19T17:29:29.076 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:29:29.076 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:29:29.076 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:29:29.076 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:29:29.079 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid0=128926 2026-02-19T17:29:29.079 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-19T17:29:29.079 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:29:29.079 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:29:29.079 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-19T17:29:29.079 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:29:29.080 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:29:29.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:29:29.082 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:29:29.082 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:29:29.082 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:29:29.082 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-19T17:29:29.082 INFO:tasks.workunit.client.0.trial119.stdout:start osd.1 2026-02-19T17:29:29.083 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-19T17:29:29.083 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:29:29.083 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-19T17:29:29.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-19T17:29:29.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:29:29.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:29:29.084 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:29:29.104 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:29.090+0000 7f669f0dda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:29.105 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:29.090+0000 7f669f0dda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:29.106 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:29.090+0000 7f669f0dda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:29.292 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-19T17:29:29.292 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:29:29.292 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-19T17:29:29.292 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:29:29.292 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:29:29.292 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:29.292 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:29:29.293 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:29:29.293 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:29.293 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:29.501 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:29.548 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:29.534+0000 7f669f0dda40 -1 Falling back to public interface 2026-02-19T17:29:30.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:30.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:30.503 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:29:30.504 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:29:30.504 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:30.504 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:30.716 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:31.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:31.718 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:31.718 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:29:31.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:29:31.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:31.719 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:31.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:32.931 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:32.931 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:32.932 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:29:32.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:29:32.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:32.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:33.144 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:34.145 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:34.145 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:34.146 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:29:34.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:29:34.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:34.147 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:34.362 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:35.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:35.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:35.364 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:29:35.364 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:29:35.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:35.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:35.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:36.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:36.577 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:36.578 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:29:36.578 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:29:36.578 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:36.579 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:36.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:37.327 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:37.314+0000 7f669f0dda40 -1 osd.1 66 log_to_monitors true 2026-02-19T17:29:37.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:37.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:37.790 INFO:tasks.workunit.client.0.trial119.stdout:7 2026-02-19T17:29:37.791 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T17:29:37.791 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:37.791 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-19T17:29:37.996 INFO:tasks.workunit.client.0.trial119.stdout:osd.1 up in weight 1 up_from 76 up_thru 76 down_at 67 last_clean_interval [56,66) [v2:127.0.0.1:6810/3871785587,v1:127.0.0.1:6811/3871785587] [v2:127.0.0.1:6812/3871785587,v1:127.0.0.1:6813/3871785587] exists,up 9d41eda0-56e2-432c-9523-22ae21e660dd 2026-02-19T17:29:37.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:29:37.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:29:37.997 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:29:37.997 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-19T17:29:38.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid1=130022 2026-02-19T17:29:38.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-19T17:29:38.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:29:38.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:29:38.001 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:29:38.002 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:29:38.003 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:29:38.004 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-19T17:29:38.005 INFO:tasks.workunit.client.0.trial119.stdout:start osd.2 2026-02-19T17:29:38.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-19T17:29:38.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:29:38.006 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-19T17:29:38.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-19T17:29:38.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:29:38.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:29:38.006 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:29:38.017 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:38.002+0000 7f70b6e9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:38.018 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:38.002+0000 7f70b6e9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:38.019 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:38.006+0000 7f70b6e9fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:38.211 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-19T17:29:38.211 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:29:38.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-19T17:29:38.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:29:38.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:29:38.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:38.212 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:29:38.212 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:29:38.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:38.213 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:38.421 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:38.460 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:38.446+0000 7f70b6e9fa40 -1 Falling back to public interface 2026-02-19T17:29:39.423 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:39.423 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:39.423 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:29:39.423 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:29:39.423 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:39.423 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:39.635 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:40.635 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:40.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:40.636 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:29:40.636 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:29:40.637 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:40.637 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:40.848 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:41.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:41.849 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:41.850 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:29:41.850 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:29:41.850 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:41.850 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:42.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:43.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:43.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:43.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:29:43.056 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:29:43.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:43.056 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:43.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:44.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:44.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:44.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:29:44.266 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:29:44.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:44.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:44.478 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:45.479 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:45.480 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:45.480 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:29:45.480 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:29:45.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:45.481 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:45.692 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:46.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:46.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:46.694 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T17:29:46.694 INFO:tasks.workunit.client.0.trial119.stdout:7 2026-02-19T17:29:46.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:46.695 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:46.912 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:46.979 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:46.966+0000 7f70b6e9fa40 -1 osd.2 68 log_to_monitors true 2026-02-19T17:29:47.913 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:47.914 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:47.914 INFO:tasks.workunit.client.0.trial119.stdout:8 2026-02-19T17:29:47.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T17:29:47.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:47.915 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-19T17:29:48.127 INFO:tasks.workunit.client.0.trial119.stdout:osd.2 up in weight 1 up_from 80 up_thru 80 down_at 69 last_clean_interval [59,68) [v2:127.0.0.1:6818/1604520415,v1:127.0.0.1:6819/1604520415] [v2:127.0.0.1:6820/1604520415,v1:127.0.0.1:6821/1604520415] exists,up 3de5c323-b138-4e54-b585-94bcdc193a0b 2026-02-19T17:29:48.128 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:29:48.128 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:29:48.128 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:29:48.128 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-19T17:29:48.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid2=131084 2026-02-19T17:29:48.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:333: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-19T17:29:48.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:29:48.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:29:48.133 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-19T17:29:48.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:29:48.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-19T17:29:48.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-19T17:29:48.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:29:48.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:29:48.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:29:48.134 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:29:48.135 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:29:48.136 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:29:48.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:29:48.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:29:48.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:29:48.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:29:48.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-19T17:29:48.137 INFO:tasks.workunit.client.0.trial119.stdout:start osd.3 2026-02-19T17:29:48.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-19T17:29:48.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:29:48.139 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-19T17:29:48.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-19T17:29:48.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:29:48.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:29:48.139 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:29:48.156 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:48.142+0000 7f037c184a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:48.157 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:48.142+0000 7f037c184a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:48.158 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:48.146+0000 7f037c184a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:29:48.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-19T17:29:48.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:29:48.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-19T17:29:48.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:29:48.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:29:48.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:48.342 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:29:48.343 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:29:48.343 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:48.343 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:48.551 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:48.676 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:48.662+0000 7f037c184a40 -1 Falling back to public interface 2026-02-19T17:29:49.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:49.553 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:49.553 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:29:49.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:29:49.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:49.554 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:49.767 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:50.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:50.769 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:50.769 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:29:50.770 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:29:50.770 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:50.770 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:50.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:51.987 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:51.987 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:51.987 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:29:51.988 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:29:51.988 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:51.988 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:52.194 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:53.195 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:53.196 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:53.196 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:29:53.196 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:29:53.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:53.197 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:53.407 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:54.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:54.409 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:54.409 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:29:54.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:29:54.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:54.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:54.624 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:55.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:55.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:55.626 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:29:55.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:29:55.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:55.627 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:55.838 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:29:56.337 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:29:56.321+0000 7f037c184a40 -1 osd.3 70 log_to_monitors true 2026-02-19T17:29:56.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:29:56.840 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:29:56.840 INFO:tasks.workunit.client.0.trial119.stdout:7 2026-02-19T17:29:56.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T17:29:56.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:29:56.841 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-19T17:29:57.053 INFO:tasks.workunit.client.0.trial119.stdout:osd.3 up in weight 1 up_from 84 up_thru 84 down_at 71 last_clean_interval [63,70) [v2:127.0.0.1:6826/3155604016,v1:127.0.0.1:6827/3155604016] [v2:127.0.0.1:6828/3155604016,v1:127.0.0.1:6829/3155604016] exists,up 15212a1a-4893-4b23-9e14-6b681a03a29c 2026-02-19T17:29:57.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:29:57.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:29:57.053 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:29:57.054 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-19T17:29:57.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: osd_pid3=132175 2026-02-19T17:29:57.055 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T17:29:57.074 INFO:tasks.workunit.client.0.trial119.stdout:hints = 1 2026-02-19T17:29:57.074 INFO:tasks.workunit.client.0.trial119.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T17:29:57.074 INFO:tasks.workunit.client.0.trial119.stdout:Object prefix: benchmark_data_trial119_133226 2026-02-19T17:29:57.074 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:29:57.074 INFO:tasks.workunit.client.0.trial119.stdout: 0 0 0 0 0 0 - 0 2026-02-19T17:29:58.074 INFO:tasks.workunit.client.0.trial119.stdout: 1 16 11045 11029 43.0787 43.082 0.00140214 0.00144825 2026-02-19T17:29:59.074 INFO:tasks.workunit.client.0.trial119.stdout: 2 16 22017 22001 42.9676 42.8594 0.00128297 0.0014526 2026-02-19T17:30:00.074 INFO:tasks.workunit.client.0.trial119.stdout: 3 15 32786 32771 42.6674 42.0703 0.00123938 0.0014629 2026-02-19T17:30:01.074 INFO:tasks.workunit.client.0.trial119.stdout: 4 16 43618 43602 42.5769 42.3086 0.00150636 0.00146603 2026-02-19T17:30:02.074 INFO:tasks.workunit.client.0.trial119.stdout: 5 16 48374 48358 37.7769 18.5781 0.0022688 0.00165267 2026-02-19T17:30:03.075 INFO:tasks.workunit.client.0.trial119.stdout: 6 16 58898 58882 38.3317 41.1094 0.00128272 0.00162881 2026-02-19T17:30:04.075 INFO:tasks.workunit.client.0.trial119.stdout: 7 16 70000 69984 39.0506 43.3672 0.000940681 0.00159884 2026-02-19T17:30:05.074 INFO:tasks.workunit.client.0.trial119.stdout: 8 16 80821 80805 39.4526 42.2695 0.000964315 0.00158246 2026-02-19T17:30:06.075 INFO:tasks.workunit.client.0.trial119.stdout: 9 16 91436 91420 39.6758 41.4648 0.00109582 0.0015736 2026-02-19T17:30:07.075 INFO:tasks.workunit.client.0.trial119.stdout: 10 16 102155 102139 39.895 41.8711 0.00167717 0.00156502 2026-02-19T17:30:08.075 INFO:tasks.workunit.client.0.trial119.stdout: 11 16 112902 112886 40.0843 41.9805 0.00160999 0.00155761 2026-02-19T17:30:09.075 INFO:tasks.workunit.client.0.trial119.stdout: 12 16 123009 122993 40.0337 39.4805 0.00193975 0.0015596 2026-02-19T17:30:10.075 INFO:tasks.workunit.client.0.trial119.stdout: 13 16 133166 133150 40.006 39.6758 0.00149585 0.00156071 2026-02-19T17:30:11.075 INFO:tasks.workunit.client.0.trial119.stdout: 14 16 143279 143263 39.9699 39.5039 0.00119102 0.00156207 2026-02-19T17:30:12.075 INFO:tasks.workunit.client.0.trial119.stdout: 15 16 152073 152057 39.5952 34.3516 0.0462395 0.00157501 2026-02-19T17:30:13.075 INFO:tasks.workunit.client.0.trial119.stdout: 16 16 154391 154375 37.6863 9.05469 0.0011353 0.00165685 2026-02-19T17:30:14.075 INFO:tasks.workunit.client.0.trial119.stdout: 17 15 164765 164750 37.8533 40.5273 0.00162713 0.00164956 2026-02-19T17:30:15.076 INFO:tasks.workunit.client.0.trial119.stdout: 18 15 174881 174866 37.9455 39.5156 0.0016527 0.00164554 2026-02-19T17:30:16.076 INFO:tasks.workunit.client.0.trial119.stdout: 19 16 185026 185010 38.0337 39.625 0.00118859 0.00164171 2026-02-19T17:30:17.076 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:30:17.066703+0000 min lat: 0.00045387 max lat: 0.185899 avg lat: 0.00163636 2026-02-19T17:30:17.076 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:30:17.076 INFO:tasks.workunit.client.0.trial119.stdout: 20 16 195403 195387 38.1586 40.5352 0.001093 0.00163636 2026-02-19T17:30:18.076 INFO:tasks.workunit.client.0.trial119.stdout: 21 16 205449 205433 38.21 39.2422 0.00128341 0.00163414 2026-02-19T17:30:19.076 INFO:tasks.workunit.client.0.trial119.stdout: 22 16 215485 215469 38.255 39.2031 0.00127144 0.00163222 2026-02-19T17:30:20.076 INFO:tasks.workunit.client.0.trial119.stdout: 23 16 225522 225506 38.2963 39.207 0.00121875 0.00163045 2026-02-19T17:30:21.076 INFO:tasks.workunit.client.0.trial119.stdout: 24 15 235590 235575 38.3393 39.332 0.00114025 0.00162865 2026-02-19T17:30:22.076 INFO:tasks.workunit.client.0.trial119.stdout: 25 15 245857 245842 38.4098 40.1055 0.00134111 0.00162566 2026-02-19T17:30:23.076 INFO:tasks.workunit.client.0.trial119.stdout: 26 16 254502 254486 38.2311 33.7656 0.019188 0.00163095 2026-02-19T17:30:24.076 INFO:tasks.workunit.client.0.trial119.stdout: 27 16 254691 254675 36.8425 0.738281 0.161606 0.00168585 2026-02-19T17:30:25.076 INFO:tasks.workunit.client.0.trial119.stdout: 28 16 254845 254829 35.5481 0.601562 0.0687356 0.00175185 2026-02-19T17:30:26.077 INFO:tasks.workunit.client.0.trial119.stdout: 29 16 255015 254999 34.3452 0.664062 0.146465 0.00181563 2026-02-19T17:30:27.077 INFO:tasks.workunit.client.0.trial119.stdout:Total time run: 30.0009 2026-02-19T17:30:27.077 INFO:tasks.workunit.client.0.trial119.stdout:Total writes made: 258623 2026-02-19T17:30:27.077 INFO:tasks.workunit.client.0.trial119.stdout:Write size: 4096 2026-02-19T17:30:27.077 INFO:tasks.workunit.client.0.trial119.stdout:Object size: 4096 2026-02-19T17:30:27.077 INFO:tasks.workunit.client.0.trial119.stdout:Bandwidth (MB/sec): 33.6739 2026-02-19T17:30:27.077 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Bandwidth: 13.7065 2026-02-19T17:30:27.077 INFO:tasks.workunit.client.0.trial119.stdout:Max bandwidth (MB/sec): 43.3672 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Min bandwidth (MB/sec): 0.601562 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Average IOPS: 8620 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Stddev IOPS: 3508.87 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Max IOPS: 11102 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Min IOPS: 154 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Average Latency(s): 0.00185453 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Latency(s): 0.00599081 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Max latency(s): 0.295483 2026-02-19T17:30:27.078 INFO:tasks.workunit.client.0.trial119.stdout:Min latency(s): 0.00045387 2026-02-19T17:30:27.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:339: TEST_bluestore: wait_for_clean 2026-02-19T17:30:27.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:30:27.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:30:27.081 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:30:27.081 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:30:27.082 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:30:27.082 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:30:27.082 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:30:27.082 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:30:27.082 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:30:27.181 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:30:27.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:30:27.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:30:27.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:30:27.182 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:30:27.182 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:30:27.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-19T17:30:27.386 INFO:tasks.workunit.client.0.trial119.stderr:1 2026-02-19T17:30:27.386 INFO:tasks.workunit.client.0.trial119.stderr:2 2026-02-19T17:30:27.386 INFO:tasks.workunit.client.0.trial119.stderr:3' 2026-02-19T17:30:27.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:30:27.387 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:30:27.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:30:27.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612622 2026-02-19T17:30:27.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612622 2026-02-19T17:30:27.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622' 2026-02-19T17:30:27.466 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:30:27.466 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-19T17:30:27.543 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=326417514509 2026-02-19T17:30:27.543 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 326417514509 2026-02-19T17:30:27.544 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622 1-326417514509' 2026-02-19T17:30:27.544 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:30:27.544 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-19T17:30:27.625 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=343597383691 2026-02-19T17:30:27.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 343597383691 2026-02-19T17:30:27.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622 1-326417514509 2-343597383691' 2026-02-19T17:30:27.626 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:30:27.626 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-19T17:30:27.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252873 2026-02-19T17:30:27.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252873 2026-02-19T17:30:27.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622 1-326417514509 2-343597383691 3-360777252873' 2026-02-19T17:30:27.707 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:30:27.707 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-313532612622 2026-02-19T17:30:27.707 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:30:27.708 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:30:27.708 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-313532612622 2026-02-19T17:30:27.709 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:30:27.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612622 2026-02-19T17:30:27.710 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 313532612622 2026-02-19T17:30:27.710 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 313532612622' 2026-02-19T17:30:27.711 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:30:27.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612620 -lt 313532612622 2026-02-19T17:30:27.933 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:30:28.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:30:28.934 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:30:29.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612623 -lt 313532612622 2026-02-19T17:30:29.141 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:30:29.142 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-326417514509 2026-02-19T17:30:29.142 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:30:29.143 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-19T17:30:29.144 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-326417514509 2026-02-19T17:30:29.145 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:30:29.146 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=326417514509 2026-02-19T17:30:29.146 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 326417514509' 2026-02-19T17:30:29.147 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.1 seq 326417514509 2026-02-19T17:30:29.147 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-19T17:30:29.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 326417514509 -lt 326417514509 2026-02-19T17:30:29.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:30:29.370 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-343597383691 2026-02-19T17:30:29.370 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:30:29.371 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-19T17:30:29.372 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-343597383691 2026-02-19T17:30:29.372 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:30:29.373 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=343597383691 2026-02-19T17:30:29.374 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.2 seq 343597383691 2026-02-19T17:30:29.374 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 343597383691' 2026-02-19T17:30:29.374 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-19T17:30:29.595 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 343597383691 -lt 343597383691 2026-02-19T17:30:29.596 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:30:29.596 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-360777252873 2026-02-19T17:30:29.597 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:30:29.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-19T17:30:29.599 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-360777252873 2026-02-19T17:30:29.599 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:30:29.600 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252873 2026-02-19T17:30:29.600 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.3 seq 360777252873 2026-02-19T17:30:29.601 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 360777252873' 2026-02-19T17:30:29.601 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-19T17:30:29.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252873 -lt 360777252873 2026-02-19T17:30:29.811 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:30:29.812 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:30:29.812 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:30:30.085 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T17:30:30.086 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:30:30.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:30:30.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:30:30.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:30:30.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:30:30.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:30:30.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:30:30.299 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T17:30:30.300 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:30:30.301 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:30:30.301 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:30:30.585 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:30:30.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:30:30.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:30:30.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:30:30.894 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:30:30.895 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:30:30.896 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:30:30.896 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:30:30.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:30:30.898 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:30:30.898 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:30:30.899 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:30:30.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:30:30.900 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:30:30.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:30:30.901 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:30:30.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:30:30.902 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T17:30:36.927 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:30:36.927 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:36.927 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:36.927 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.88022 2026-02-19T17:30:36.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:30:36.929 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:30:36.930 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:30:36.931 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:30:36.931 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:30:36.932 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:30:36.932 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:30:36.933 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:30:36.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:30:36.934 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:30:36.934 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:30:36.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:30:36.935 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:30:36.936 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:30:36.936 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:30:36.937 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:30:36.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:30:36.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T17:30:36.939 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:30:36.939 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:36.939 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:36.940 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.88022 2026-02-19T17:30:36.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:30:36.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:30:36.941 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-19T17:30:36.942 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:30:36.942 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:36.943 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:36.943 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.88022 2026-02-19T17:30:36.944 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:30:36.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T17:30:36.945 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore2 td/osd-bluefs-volume-ops 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:343: TEST_bluestore2: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: ulimit -n 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: local flimit=4096 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:346: TEST_bluestore2: '[' 4096 -lt 1536 ']' 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: export CEPH_MON=127.0.0.1:7146 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: CEPH_MON=127.0.0.1:7146 2026-02-19T17:30:36.946 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:350: TEST_bluestore2: export CEPH_ARGS 2026-02-19T17:30:36.948 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: uuidgen 2026-02-19T17:30:36.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: CEPH_ARGS+='--fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none ' 2026-02-19T17:30:36.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:352: TEST_bluestore2: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-19T17:30:36.948 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:353: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:354: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:355: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:356: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:357: TEST_bluestore2: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:358: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:359: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:360: TEST_bluestore2: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:362: TEST_bluestore2: run_mon td/osd-bluefs-volume-ops a 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:36.949 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:30:36.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:30:36.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:30:36.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-19T17:30:36.950 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:36.974 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:30:36.974 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:30:36.974 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:30:36.974 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:30:36.974 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:36.974 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:36.975 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:30:36.975 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:30:37.008 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:30:37.009 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:30:37.009 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:30:37.009 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:30:37.009 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.88022/ceph-mon.a.asok 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:30:37.011 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.88022/ceph-mon.a.asok config get fsid 2026-02-19T17:30:37.067 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:30:37.067 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:30:37.067 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:30:37.067 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:30:37.068 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:30:37.069 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:30:37.069 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:30:37.069 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:30:37.069 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:30:37.069 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:37.069 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:37.070 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.88022/ceph-mon.a.asok 2026-02-19T17:30:37.070 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:30:37.070 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.88022/ceph-mon.a.asok config get mon_host 2026-02-19T17:30:37.125 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:363: TEST_bluestore2: run_mgr td/osd-bluefs-volume-ops x 2026-02-19T17:30:37.125 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:37.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:30:37.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:30:37.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:30:37.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-19T17:30:37.126 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:30:37.239 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:30:37.239 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:30:37.240 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:30:37.240 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:30:37.240 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:37.240 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:37.240 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:30:37.240 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:30:37.241 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:30:37.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:364: TEST_bluestore2: run_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:30:37.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:30:37.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:30:37.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:30:37.264 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:30:37.265 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:30:37.266 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:30:37.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:30:37.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:30:37.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:30:37.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:30:37.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:30:37.267 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:30:37.268 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:30:37.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=172f9d5f-8324-4742-80db-f101fa68e278 2026-02-19T17:30:37.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 172f9d5f-8324-4742-80db-f101fa68e278' 2026-02-19T17:30:37.268 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 172f9d5f-8324-4742-80db-f101fa68e278 2026-02-19T17:30:37.268 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:30:37.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC9SJdpFiYPEBAAR7vyCWyplCXdY3QHNbyWug== 2026-02-19T17:30:37.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC9SJdpFiYPEBAAR7vyCWyplCXdY3QHNbyWug=="}' 2026-02-19T17:30:37.280 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 172f9d5f-8324-4742-80db-f101fa68e278 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-19T17:30:37.391 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:30:37.399 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-19T17:30:37.400 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC9SJdpFiYPEBAAR7vyCWyplCXdY3QHNbyWug== --osd-uuid 172f9d5f-8324-4742-80db-f101fa68e278 2026-02-19T17:30:37.418 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:37.405+0000 7fc63770da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:30:37.420 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:37.409+0000 7fc63770da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:30:37.421 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:37.409+0000 7fc63770da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:30:37.421 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:37.409+0000 7fc63770da40 -1 bdev(0x557346d00800 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:30:37.422 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:37.409+0000 7fc63770da40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-19T17:30:39.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-19T17:30:39.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:30:39.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:30:39.012 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:30:39.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:30:39.137 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:30:39.137 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:30:39.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:30:39.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:30:39.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:30:39.138 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:30:39.167 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:39.153+0000 7f3b71db0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:30:39.169 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:39.157+0000 7f3b71db0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:30:39.170 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:39.157+0000 7f3b71db0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:30:39.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:30:39.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:30:39.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:30:39.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:30:39.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:30:39.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:30:39.251 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:30:39.251 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:30:39.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:30:39.252 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:30:39.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:30:39.733 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:39.721+0000 7f3b71db0a40 -1 Falling back to public interface 2026-02-19T17:30:40.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:30:40.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:30:40.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:30:40.368 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:30:40.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:30:40.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:30:40.583 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:30:40.819 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:30:40.805+0000 7f3b71db0a40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:30:41.584 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:30:41.585 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:30:41.585 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:30:41.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:30:41.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:30:41.586 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:30:41.800 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3070919958,v1:127.0.0.1:6803/3070919958] [v2:127.0.0.1:6804/3070919958,v1:127.0.0.1:6805/3070919958] exists,up 172f9d5f-8324-4742-80db-f101fa68e278 2026-02-19T17:30:41.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:30:41.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:30:41.801 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:30:41.802 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:30:41.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: osd_pid0=135064 2026-02-19T17:30:41.802 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:367: TEST_bluestore2: sleep 5 2026-02-19T17:30:46.804 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:368: TEST_bluestore2: create_pool foo 16 2026-02-19T17:30:46.804 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-19T17:30:47.069 INFO:tasks.workunit.client.0.trial119.stderr:pool 'foo' already exists 2026-02-19T17:30:47.080 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:30:48.082 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:370: TEST_bluestore2: retry = 0 2026-02-19T17:30:48.083 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 370: retry: command not found 2026-02-19T17:30:48.083 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:371: TEST_bluestore2: [[ '' -le 5 ]] 2026-02-19T17:30:48.083 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:373: TEST_bluestore2: timeout 60 rados bench -p foo 10 write --write-omap --no-cleanup 2026-02-19T17:30:48.106 INFO:tasks.workunit.client.0.trial119.stdout:hints = 1 2026-02-19T17:30:48.107 INFO:tasks.workunit.client.0.trial119.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects 2026-02-19T17:30:48.107 INFO:tasks.workunit.client.0.trial119.stdout:Object prefix: benchmark_data_trial119_137613 2026-02-19T17:30:48.150 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:30:48.151 INFO:tasks.workunit.client.0.trial119.stdout: 0 0 0 0 0 0 - 0 2026-02-19T17:30:49.151 INFO:tasks.workunit.client.0.trial119.stdout: 1 16 177 161 643.932 644 0.0905735 0.0974583 2026-02-19T17:30:50.151 INFO:tasks.workunit.client.0.trial119.stdout: 2 16 357 341 681.926 720 0.0809389 0.0907599 2026-02-19T17:30:51.151 INFO:tasks.workunit.client.0.trial119.stdout: 3 16 544 528 703.929 748 0.0865765 0.089874 2026-02-19T17:30:52.151 INFO:tasks.workunit.client.0.trial119.stdout: 4 16 725 709 708.932 724 0.0919388 0.0895292 2026-02-19T17:30:53.151 INFO:tasks.workunit.client.0.trial119.stdout: 5 16 928 912 729.532 812 0.0680482 0.0870809 2026-02-19T17:30:54.151 INFO:tasks.workunit.client.0.trial119.stdout: 6 16 1125 1109 739.265 788 0.0833357 0.0862496 2026-02-19T17:30:55.151 INFO:tasks.workunit.client.0.trial119.stdout: 7 16 1285 1269 725.075 640 0.103791 0.0876106 2026-02-19T17:30:56.151 INFO:tasks.workunit.client.0.trial119.stdout: 8 16 1477 1461 730.432 768 0.0946713 0.0871446 2026-02-19T17:30:57.152 INFO:tasks.workunit.client.0.trial119.stdout: 9 16 1680 1664 739.486 812 0.0946982 0.0862847 2026-02-19T17:30:58.152 INFO:tasks.workunit.client.0.trial119.stdout: 10 16 1861 1845 737.927 724 0.0826384 0.0864806 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Total time run: 10.0728 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Total writes made: 1861 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Write size: 4194304 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Object size: 4194304 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Bandwidth (MB/sec): 739.017 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Bandwidth: 61.1083 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Max bandwidth (MB/sec): 812 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Min bandwidth (MB/sec): 640 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Average IOPS: 184 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Stddev IOPS: 15.2771 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Max IOPS: 203 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Min IOPS: 160 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Average Latency(s): 0.0864534 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Latency(s): 0.0123344 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Max latency(s): 0.128145 2026-02-19T17:30:59.152 INFO:tasks.workunit.client.0.trial119.stdout:Min latency(s): 0.0356674 2026-02-19T17:30:59.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:376: TEST_bluestore2: sleep 10 2026-02-19T17:31:09.167 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-19T17:31:09.167 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: jq .bluefs.db_used_bytes 2026-02-19T17:31:09.250 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: db_used=502267904 2026-02-19T17:31:09.251 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-19T17:31:09.251 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: jq .bluefs.slow_used_bytes 2026-02-19T17:31:09.337 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: spilled_over=161087488 2026-02-19T17:31:09.337 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:380: TEST_bluestore2: (( retry+=1 )) 2026-02-19T17:31:09.337 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: test 161087488 -eq 0 2026-02-19T17:31:09.337 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: break 2026-02-19T17:31:09.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:383: TEST_bluestore2: test 161087488 -gt 0 2026-02-19T17:31:09.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 135064 2026-02-19T17:31:09.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: sleep 1 2026-02-19T17:31:10.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 135064 2026-02-19T17:31:10.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 385: kill: (135064) - No such process 2026-02-19T17:31:10.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:386: TEST_bluestore2: ceph osd down 0 2026-02-19T17:31:10.549 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:31:10.561 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:388: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/block --command bluefs-bdev-migrate 2026-02-19T17:31:10.575 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:31:11.919 INFO:tasks.workunit.client.0.trial119.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-19T17:31:11.938 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:393: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command bluefs-bdev-sizes 2026-02-19T17:31:11.958 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:31:12.327 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x100000000(4 GiB) : using 0x273b8000(628 MiB) : bluefs used 0x273a0000(628 MiB) : non-bluefs used 0x18000(96 KiB) 2026-02-19T17:31:12.413 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:396: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command fsck 2026-02-19T17:31:14.079 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:31:14.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:399: TEST_bluestore2: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:31:14.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:14.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:31:14.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:31:14.159 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:31:14.160 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:31:14.161 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:31:14.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:31:14.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:31:14.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:31:14.162 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:31:14.162 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:31:14.163 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:31:14.163 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:31:14.164 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T17:31:14.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:31:14.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:31:14.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:31:14.164 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:31:14.183 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:14.172+0000 7fb6d9b6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:14.185 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:14.172+0000 7fb6d9b6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:14.186 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:14.172+0000 7fb6d9b6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:14.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:31:14.375 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:31:14.376 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:31:14.593 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:14.580+0000 7fb6d9b6ba40 -1 Falling back to public interface 2026-02-19T17:31:14.596 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:31:15.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:31:15.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:31:15.598 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:31:15.599 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:31:15.599 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:31:15.599 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:31:15.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:31:16.815 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:31:16.815 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:31:16.816 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:31:16.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:31:16.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:31:16.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:31:17.028 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:31:17.208 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:17.196+0000 7fb6d9b6ba40 -1 osd.0 9 log_to_monitors true 2026-02-19T17:31:18.029 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:31:18.029 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:31:18.029 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:31:18.029 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:31:18.030 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:31:18.030 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:31:18.246 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 12 up_thru 12 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6802/3448384113,v1:127.0.0.1:6803/3448384113] [v2:127.0.0.1:6804/3448384113,v1:127.0.0.1:6805/3448384113] exists,up 172f9d5f-8324-4742-80db-f101fa68e278 2026-02-19T17:31:18.246 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:31:18.247 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:31:18.247 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:31:18.247 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:31:18.248 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: osd_pid0=138844 2026-02-19T17:31:18.248 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:402: TEST_bluestore2: wait_for_clean 2026-02-19T17:31:18.248 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:31:18.248 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:31:18.248 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:31:18.249 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:31:18.249 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:31:18.249 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:31:18.250 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:31:18.250 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:31:18.250 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:31:18.349 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:31:18.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:31:18.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:31:18.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:31:18.350 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:31:18.350 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:31:18.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-19T17:31:18.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:31:18.576 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:31:18.576 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:31:18.658 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607555 2026-02-19T17:31:18.658 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607555 2026-02-19T17:31:18.658 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-51539607555' 2026-02-19T17:31:18.658 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:31:18.659 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-51539607555 2026-02-19T17:31:18.659 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:31:18.660 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:31:18.660 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-51539607555 2026-02-19T17:31:18.660 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:31:18.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=51539607555 2026-02-19T17:31:18.662 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-19T17:31:18.662 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 51539607555 2026-02-19T17:31:18.663 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:31:18.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 51539607555 2026-02-19T17:31:18.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:31:19.885 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:31:19.886 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:31:20.104 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-19T17:31:20.104 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:31:20.105 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:31:20.105 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:31:20.386 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T17:31:20.387 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:31:20.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:31:20.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:31:20.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:31:20.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:31:20.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:31:20.387 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:31:20.598 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T17:31:20.599 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:31:20.599 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:31:20.600 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:31:20.881 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T17:31:20.881 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:31:20.881 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:31:20.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:31:20.988 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:31:20.989 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:31:20.989 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:31:20.990 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:31:20.991 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:31:20.991 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:31:20.991 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:31:20.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:31:20.992 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:31:20.993 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:31:20.993 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:31:20.994 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:31:20.995 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:31:20.995 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T17:31:21.330 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:31:21.331 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.331 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.331 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.88022 2026-02-19T17:31:21.333 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:31:21.333 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:31:21.333 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-19T17:31:21.333 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:31:21.334 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:31:21.336 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:31:21.336 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:31:21.336 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:31:21.337 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:31:21.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:31:21.338 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:31:21.338 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:31:21.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:31:21.339 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:31:21.340 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:31:21.340 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:31:21.341 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:31:21.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-19T17:31:21.342 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T17:31:21.344 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:31:21.344 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.344 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.88022 2026-02-19T17:31:21.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:31:21.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:31:21.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-19T17:31:21.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-19T17:31:21.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.88022 2026-02-19T17:31:21.351 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-19T17:31:21.351 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-19T17:31:21.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-19T17:31:21.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-19T17:31:21.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore_expand td/osd-bluefs-volume-ops 2026-02-19T17:31:21.352 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:406: TEST_bluestore_expand: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:21.352 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: ulimit -n 2026-02-19T17:31:21.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: local flimit=4096 2026-02-19T17:31:21.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:409: TEST_bluestore_expand: '[' 4096 -lt 1536 ']' 2026-02-19T17:31:21.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: export CEPH_MON=127.0.0.1:7146 2026-02-19T17:31:21.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: CEPH_MON=127.0.0.1:7146 2026-02-19T17:31:21.353 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:413: TEST_bluestore_expand: export CEPH_ARGS 2026-02-19T17:31:21.353 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: uuidgen 2026-02-19T17:31:21.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: CEPH_ARGS+='--fsid=ce05e8e5-6954-44a0-9bcf-ecd1fec699cc --auth-supported=none ' 2026-02-19T17:31:21.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:415: TEST_bluestore_expand: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-19T17:31:21.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:416: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-19T17:31:21.357 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:417: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-19T17:31:21.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:418: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-19T17:31:21.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:419: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-19T17:31:21.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:420: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-19T17:31:21.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:421: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-19T17:31:21.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:422: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-19T17:31:21.358 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:423: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-19T17:31:21.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:425: TEST_bluestore_expand: run_mon td/osd-bluefs-volume-ops a 2026-02-19T17:31:21.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:21.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-19T17:31:21.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-19T17:31:21.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-19T17:31:21.359 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-19T17:31:21.360 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:21.380 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-19T17:31:21.380 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:31:21.380 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:31:21.380 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:31:21.380 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.381 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.381 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:31:21.381 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-19T17:31:21.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-19T17:31:21.411 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-19T17:31:21.412 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:31:21.412 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:31:21.412 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-19T17:31:21.412 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-19T17:31:21.412 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:31:21.413 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:31:21.413 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:31:21.413 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:31:21.413 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.413 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.413 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.88022/ceph-mon.a.asok 2026-02-19T17:31:21.414 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:31:21.414 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.88022/ceph-mon.a.asok config get fsid 2026-02-19T17:31:21.469 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-19T17:31:21.469 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-19T17:31:21.469 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-19T17:31:21.469 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-19T17:31:21.469 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-19T17:31:21.470 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-19T17:31:21.470 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-19T17:31:21.470 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-19T17:31:21.470 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-19T17:31:21.470 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.470 INFO:tasks.workunit.client.0.trial119.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.471 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.88022/ceph-mon.a.asok 2026-02-19T17:31:21.471 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-19T17:31:21.471 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.88022/ceph-mon.a.asok config get mon_host 2026-02-19T17:31:21.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:426: TEST_bluestore_expand: run_mgr td/osd-bluefs-volume-ops x 2026-02-19T17:31:21.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:21.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-19T17:31:21.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-19T17:31:21.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-19T17:31:21.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-19T17:31:21.526 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-19T17:31:21.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-19T17:31:21.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:31:21.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:31:21.642 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:31:21.642 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.642 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.642 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:31:21.643 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:31:21.644 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-19T17:31:21.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:427: TEST_bluestore_expand: run_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:31:21.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:31:21.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-19T17:31:21.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-19T17:31:21.670 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-19T17:31:21.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:31:21.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=ce05e8e5-6954-44a0-9bcf-ecd1fec699cc --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T17:31:21.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:31:21.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:31:21.671 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:31:21.672 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-19T17:31:21.673 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:31:21.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:31:21.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:31:21.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:31:21.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:31:21.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:31:21.674 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-19T17:31:21.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-19T17:31:21.675 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:31:21.676 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-19T17:31:21.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9de54b94-e753-4706-84eb-8de528a82b05 2026-02-19T17:31:21.676 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 9de54b94-e753-4706-84eb-8de528a82b05' 2026-02-19T17:31:21.677 INFO:tasks.workunit.client.0.trial119.stdout:add osd0 9de54b94-e753-4706-84eb-8de528a82b05 2026-02-19T17:31:21.678 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-19T17:31:21.687 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDpSJdpTZJVKBAAVNbd7smBKy5hM7jduZCWWg== 2026-02-19T17:31:21.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDpSJdpTZJVKBAAVNbd7smBKy5hM7jduZCWWg=="}' 2026-02-19T17:31:21.688 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9de54b94-e753-4706-84eb-8de528a82b05 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-19T17:31:21.803 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:31:21.811 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-19T17:31:21.813 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=ce05e8e5-6954-44a0-9bcf-ecd1fec699cc --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDpSJdpTZJVKBAAVNbd7smBKy5hM7jduZCWWg== --osd-uuid 9de54b94-e753-4706-84eb-8de528a82b05 2026-02-19T17:31:21.834 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:21.820+0000 7f8ae5dbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:21.836 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:21.824+0000 7f8ae5dbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:21.837 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:21.824+0000 7f8ae5dbea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:21.837 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:21.824+0000 7f8ae5dbea40 -1 bdev(0x55724e218800 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-19T17:31:21.837 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:21.824+0000 7f8ae5dbea40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-19T17:31:23.279 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-19T17:31:23.279 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-19T17:31:23.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-19T17:31:23.281 INFO:tasks.workunit.client.0.trial119.stdout:adding osd0 key to auth repository 2026-02-19T17:31:23.281 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-19T17:31:23.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-19T17:31:23.410 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:31:23.410 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=ce05e8e5-6954-44a0-9bcf-ecd1fec699cc --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:31:23.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-19T17:31:23.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-19T17:31:23.411 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-19T17:31:23.446 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:23.432+0000 7f4d2ac24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:23.448 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:23.436+0000 7f4d2ac24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:23.449 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:23.436+0000 7f4d2ac24a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:31:23.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-19T17:31:23.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:31:23.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:31:23.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:31:23.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:31:23.527 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:31:23.527 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:31:23.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:31:23.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:31:23.528 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:31:23.641 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:31:24.049 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:24.036+0000 7f4d2ac24a40 -1 Falling back to public interface 2026-02-19T17:31:24.643 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:31:24.643 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:31:24.643 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:31:24.644 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:31:24.644 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:31:24.644 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:31:24.860 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:31:25.171 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:31:25.156+0000 7f4d2ac24a40 -1 osd.0 0 log_to_monitors true 2026-02-19T17:31:25.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:31:25.862 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:31:25.863 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:31:25.863 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:31:25.863 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:31:25.864 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:31:26.086 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1015153805,v1:127.0.0.1:6803/1015153805] [v2:127.0.0.1:6804/1015153805,v1:127.0.0.1:6805/1015153805] exists,up 9de54b94-e753-4706-84eb-8de528a82b05 2026-02-19T17:31:26.086 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:31:26.087 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:31:26.087 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:31:26.087 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:31:26.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: osd_pid0=141404 2026-02-19T17:31:26.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:430: TEST_bluestore_expand: sleep 5 2026-02-19T17:31:31.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:431: TEST_bluestore_expand: create_pool foo 16 2026-02-19T17:31:31.089 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-19T17:31:31.355 INFO:tasks.workunit.client.0.trial119.stderr:pool 'foo' already exists 2026-02-19T17:31:31.365 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-19T17:31:32.367 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:434: TEST_bluestore_expand: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-19T17:31:32.391 INFO:tasks.workunit.client.0.trial119.stdout:hints = 1 2026-02-19T17:31:32.391 INFO:tasks.workunit.client.0.trial119.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-19T17:31:32.391 INFO:tasks.workunit.client.0.trial119.stdout:Object prefix: benchmark_data_trial119_143417 2026-02-19T17:31:32.391 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:31:32.391 INFO:tasks.workunit.client.0.trial119.stdout: 0 0 0 0 0 0 - 0 2026-02-19T17:31:33.391 INFO:tasks.workunit.client.0.trial119.stdout: 1 16 15102 15086 58.9251 58.9297 0.0014822 0.00105897 2026-02-19T17:31:34.391 INFO:tasks.workunit.client.0.trial119.stdout: 2 16 30135 30119 58.8216 58.7227 0.000823794 0.00106124 2026-02-19T17:31:35.391 INFO:tasks.workunit.client.0.trial119.stdout: 3 16 45241 45225 58.8822 59.0078 0.000663859 0.00106019 2026-02-19T17:31:36.391 INFO:tasks.workunit.client.0.trial119.stdout: 4 16 60602 60586 59.1615 60.0039 0.00131985 0.00105522 2026-02-19T17:31:37.391 INFO:tasks.workunit.client.0.trial119.stdout: 5 16 75939 75923 59.3104 59.9102 0.000749487 0.00105261 2026-02-19T17:31:38.391 INFO:tasks.workunit.client.0.trial119.stdout: 6 16 91029 91013 59.2488 58.9453 0.00105776 0.00105373 2026-02-19T17:31:39.391 INFO:tasks.workunit.client.0.trial119.stdout: 7 16 106219 106203 59.2606 59.3359 0.000872033 0.00105355 2026-02-19T17:31:40.392 INFO:tasks.workunit.client.0.trial119.stdout: 8 16 120384 120368 58.7689 55.332 0.000894325 0.00106238 2026-02-19T17:31:41.392 INFO:tasks.workunit.client.0.trial119.stdout: 9 16 134753 134737 58.4751 56.1289 0.00198873 0.00106778 2026-02-19T17:31:42.392 INFO:tasks.workunit.client.0.trial119.stdout: 10 15 149063 149048 58.2174 55.9023 0.00099419 0.0010725 2026-02-19T17:31:43.392 INFO:tasks.workunit.client.0.trial119.stdout: 11 16 163073 163057 57.8993 54.7227 0.00117042 0.00107838 2026-02-19T17:31:44.392 INFO:tasks.workunit.client.0.trial119.stdout: 12 16 176539 176523 57.4575 52.6016 0.000802225 0.0010867 2026-02-19T17:31:45.392 INFO:tasks.workunit.client.0.trial119.stdout: 13 16 189853 189837 57.038 52.0078 0.000851606 0.00109469 2026-02-19T17:31:46.392 INFO:tasks.workunit.client.0.trial119.stdout: 14 16 202963 202947 56.6215 51.2109 0.000954656 0.00110276 2026-02-19T17:31:47.392 INFO:tasks.workunit.client.0.trial119.stdout: 15 16 216192 216176 56.2915 51.6758 0.00111711 0.00110923 2026-02-19T17:31:48.393 INFO:tasks.workunit.client.0.trial119.stdout: 16 16 229263 229247 55.9642 51.0586 0.00174138 0.00111571 2026-02-19T17:31:49.392 INFO:tasks.workunit.client.0.trial119.stdout: 17 16 242368 242352 55.6832 51.1914 0.000857106 0.00112137 2026-02-19T17:31:50.392 INFO:tasks.workunit.client.0.trial119.stdout: 18 16 255458 255442 55.4302 51.1328 0.00180532 0.00112648 2026-02-19T17:31:51.393 INFO:tasks.workunit.client.0.trial119.stdout: 19 16 268492 268476 55.1923 50.9141 0.00119508 0.00113134 2026-02-19T17:31:52.393 INFO:tasks.workunit.client.0.trial119.stdout:2026-02-19T17:31:52.382802+0000 min lat: 0.000343496 max lat: 0.0051104 avg lat: 0.00113382 2026-02-19T17:31:52.393 INFO:tasks.workunit.client.0.trial119.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-19T17:31:52.393 INFO:tasks.workunit.client.0.trial119.stdout: 20 16 282006 281990 55.0719 52.7891 0.000852898 0.00113382 2026-02-19T17:31:53.393 INFO:tasks.workunit.client.0.trial119.stdout: 21 16 295696 295680 54.9957 53.4766 0.000853749 0.0011354 2026-02-19T17:31:54.393 INFO:tasks.workunit.client.0.trial119.stdout: 22 16 308264 308248 54.7273 49.0938 0.0253606 0.00113742 2026-02-19T17:31:55.393 INFO:tasks.workunit.client.0.trial119.stdout: 23 16 308691 308675 52.4204 1.66797 0.100711 0.00118599 2026-02-19T17:31:56.393 INFO:tasks.workunit.client.0.trial119.stdout: 24 16 309301 309285 50.3355 2.38281 0.0117148 0.00124036 2026-02-19T17:31:57.393 INFO:tasks.workunit.client.0.trial119.stdout: 25 16 309841 309825 48.4064 2.10938 0.0262823 0.0012896 2026-02-19T17:31:58.393 INFO:tasks.workunit.client.0.trial119.stdout: 26 16 310163 310147 46.593 1.25781 0.126262 0.00133666 2026-02-19T17:31:59.393 INFO:tasks.workunit.client.0.trial119.stdout: 27 16 310275 310259 44.8836 0.4375 0.108264 0.00138832 2026-02-19T17:32:00.393 INFO:tasks.workunit.client.0.trial119.stdout: 28 15 320252 320237 44.6725 38.9766 0.00105355 0.00139803 2026-02-19T17:32:01.393 INFO:tasks.workunit.client.0.trial119.stdout: 29 15 333630 333615 44.9339 52.2578 0.00129346 0.00138988 2026-02-19T17:32:02.394 INFO:tasks.workunit.client.0.trial119.stdout:Total time run: 30.0007 2026-02-19T17:32:02.394 INFO:tasks.workunit.client.0.trial119.stdout:Total writes made: 346798 2026-02-19T17:32:02.394 INFO:tasks.workunit.client.0.trial119.stdout:Write size: 4096 2026-02-19T17:32:02.394 INFO:tasks.workunit.client.0.trial119.stdout:Object size: 4096 2026-02-19T17:32:02.394 INFO:tasks.workunit.client.0.trial119.stdout:Bandwidth (MB/sec): 45.155 2026-02-19T17:32:02.394 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Bandwidth: 20.5969 2026-02-19T17:32:02.394 INFO:tasks.workunit.client.0.trial119.stdout:Max bandwidth (MB/sec): 60.0039 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Min bandwidth (MB/sec): 0.4375 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Average IOPS: 11559 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Stddev IOPS: 5272.8 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Max IOPS: 15361 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Min IOPS: 112 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Average Latency(s): 0.0013831 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Stddev Latency(s): 0.00441501 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Max latency(s): 0.190112 2026-02-19T17:32:02.395 INFO:tasks.workunit.client.0.trial119.stdout:Min latency(s): 0.000343496 2026-02-19T17:32:02.398 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:435: TEST_bluestore_expand: sleep 5 2026-02-19T17:32:07.400 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-19T17:32:07.401 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-19T17:32:07.486 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: total_space_before=4294967296 2026-02-19T17:32:07.487 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-19T17:32:07.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-19T17:32:07.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep free 2026-02-19T17:32:07.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d: -f 2 2026-02-19T17:32:07.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d, -f 1 2026-02-19T17:32:07.488 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-19T17:32:07.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: free_space_before=2874392576 2026-02-19T17:32:07.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 141404 2026-02-19T17:32:07.568 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: sleep 1 2026-02-19T17:32:08.569 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 141404 2026-02-19T17:32:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 441: kill: (141404) - No such process 2026-02-19T17:32:08.570 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:442: TEST_bluestore_expand: ceph osd down 0 2026-02-19T17:32:08.779 INFO:tasks.workunit.client.0.trial119.stderr:osd.0 is already down. 2026-02-19T17:32:08.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:445: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 allocmap 2026-02-19T17:32:08.812 INFO:tasks.workunit.client.0.trial119.stdout:allocmap bluestore.allocmap 2026-02-19T17:32:47.144 INFO:tasks.workunit.client.0.trial119.stdout:allocmap success 2026-02-19T17:32:47.170 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:448: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:33:28.240 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:33:28.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:450: TEST_bluestore_expand: requested_space=4294967296 2026-02-19T17:33:28.268 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:451: TEST_bluestore_expand: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-19T17:33:28.269 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:452: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-19T17:33:28.294 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:34:05.610 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x40000000(1 GiB) : using 0x27900000(633 MiB) 2026-02-19T17:34:05.611 INFO:tasks.workunit.client.0.trial119.stdout:2 : device size 0x100000000(4 GiB) : using 0x54ac6000(1.3 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x54ac6000(1.3 GiB) 2026-02-19T17:34:05.611 INFO:tasks.workunit.client.0.trial119.stdout:Expanding DB/WAL... 2026-02-19T17:34:05.611 INFO:tasks.workunit.client.0.trial119.stdout:1 : nothing to do, skipped 2026-02-19T17:34:05.611 INFO:tasks.workunit.client.0.trial119.stdout:2 : nothing to do, skipped 2026-02-19T17:34:05.754 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:455: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-19T17:34:47.172 INFO:tasks.workunit.client.0.trial119.stdout:fsck success 2026-02-19T17:34:47.198 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:458: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 qfsck 2026-02-19T17:34:47.215 INFO:tasks.workunit.client.0.trial119.stdout:qfsck bluestore.quick-fsck 2026-02-19T17:35:26.616 INFO:tasks.workunit.client.0.trial119.stdout:qfsck success 2026-02-19T17:35:26.639 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:460: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-19T17:35:26.655 INFO:tasks.workunit.client.0.trial119.stdout:inferring bluefs devices from bluestore path 2026-02-19T17:36:05.221 INFO:tasks.workunit.client.0.trial119.stdout:1 : device size 0x40000000(1 GiB) : using 0x27900000(633 MiB) 2026-02-19T17:36:05.221 INFO:tasks.workunit.client.0.trial119.stdout:2 : device size 0x100000000(4 GiB) : using 0x54ac6000(1.3 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x54ac6000(1.3 GiB) 2026-02-19T17:36:05.343 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:462: TEST_bluestore_expand: activate_osd td/osd-bluefs-volume-ops 0 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=ce05e8e5-6954-44a0-9bcf-ecd1fec699cc --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-19T17:36:05.344 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' 2026-02-19T17:36:05.345 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-19T17:36:05.346 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-19T17:36:05.347 INFO:tasks.workunit.client.0.trial119.stdout:start osd.0 2026-02-19T17:36:05.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-19T17:36:05.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=2d9e46cc-8fda-4783-be13-e0af2989e9c2 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=170c6d8f-6614-4b60-b314-2136cb792b88 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=ce05e8e5-6954-44a0-9bcf-ecd1fec699cc --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.88022/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-19T17:36:05.348 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-19T17:36:05.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-19T17:36:05.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-19T17:36:05.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-19T17:36:05.348 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-19T17:36:05.373 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:36:05.358+0000 7f91f55b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:36:05.374 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:36:05.358+0000 7f91f55b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:36:05.375 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:36:05.362+0000 7f91f55b3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-19T17:36:05.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-19T17:36:05.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-19T17:36:05.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-19T17:36:05.572 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-19T17:36:05.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-19T17:36:05.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:05.573 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-19T17:36:05.573 INFO:tasks.workunit.client.0.trial119.stdout:0 2026-02-19T17:36:05.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:05.574 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:05.787 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:05.872 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:36:05.858+0000 7f91f55b3a40 -1 Falling back to public interface 2026-02-19T17:36:06.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:06.788 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:06.789 INFO:tasks.workunit.client.0.trial119.stdout:1 2026-02-19T17:36:06.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-19T17:36:06.789 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:06.790 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:07.009 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:08.010 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:08.011 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:08.011 INFO:tasks.workunit.client.0.trial119.stdout:2 2026-02-19T17:36:08.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-19T17:36:08.012 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:08.013 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:08.225 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:09.227 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:09.228 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:09.228 INFO:tasks.workunit.client.0.trial119.stdout:3 2026-02-19T17:36:09.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-19T17:36:09.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:09.229 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:09.444 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:10.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:10.446 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:10.447 INFO:tasks.workunit.client.0.trial119.stdout:4 2026-02-19T17:36:10.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-19T17:36:10.447 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:10.448 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:10.665 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:11.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:11.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:11.667 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-19T17:36:11.667 INFO:tasks.workunit.client.0.trial119.stdout:5 2026-02-19T17:36:11.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:11.668 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:11.880 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:12.882 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:12.883 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:12.883 INFO:tasks.workunit.client.0.trial119.stdout:6 2026-02-19T17:36:12.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-19T17:36:12.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:12.884 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:13.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:14.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:14.100 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:14.101 INFO:tasks.workunit.client.0.trial119.stdout:7 2026-02-19T17:36:14.101 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-19T17:36:14.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:14.102 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:14.317 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:15.318 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:15.319 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:15.319 INFO:tasks.workunit.client.0.trial119.stdout:8 2026-02-19T17:36:15.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-19T17:36:15.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:15.320 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:15.537 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:16.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:16.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:16.539 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2026-02-19T17:36:16.539 INFO:tasks.workunit.client.0.trial119.stdout:9 2026-02-19T17:36:16.540 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:16.540 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:16.757 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-19T17:36:17.142 INFO:tasks.workunit.client.0.trial119.stderr:2026-02-19T17:36:17.126+0000 7f91f55b3a40 -1 osd.0 9 log_to_monitors true 2026-02-19T17:36:17.758 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-19T17:36:17.759 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-19T17:36:17.759 INFO:tasks.workunit.client.0.trial119.stdout:10 2026-02-19T17:36:17.760 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2026-02-19T17:36:17.760 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-19T17:36:17.760 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-19T17:36:17.970 INFO:tasks.workunit.client.0.trial119.stdout:osd.0 up in weight 1 up_from 12 up_thru 12 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6802/3370151117,v1:127.0.0.1:6803/3370151117] [v2:127.0.0.1:6804/3370151117,v1:127.0.0.1:6805/3370151117] exists,up 9de54b94-e753-4706-84eb-8de528a82b05 2026-02-19T17:36:17.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-19T17:36:17.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-19T17:36:17.971 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-19T17:36:17.972 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-19T17:36:17.972 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: osd_pid0=145789 2026-02-19T17:36:17.972 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:465: TEST_bluestore_expand: wait_for_clean 2026-02-19T17:36:17.973 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-19T17:36:17.973 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-19T17:36:17.973 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-19T17:36:17.973 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-19T17:36:17.974 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-19T17:36:17.974 INFO:tasks.workunit.client.0.trial119.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-19T17:36:17.974 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-19T17:36:17.974 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-19T17:36:17.974 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-19T17:36:18.073 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-19T17:36:18.074 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-19T17:36:18.074 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-19T17:36:18.074 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-19T17:36:18.074 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-19T17:36:18.074 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-19T17:36:18.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-19T17:36:18.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-19T17:36:18.282 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-19T17:36:18.282 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-19T17:36:18.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607555 2026-02-19T17:36:18.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607555 2026-02-19T17:36:18.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-51539607555' 2026-02-19T17:36:18.368 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-19T17:36:18.369 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-51539607555 2026-02-19T17:36:18.369 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-19T17:36:18.369 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-19T17:36:18.370 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-51539607555 2026-02-19T17:36:18.370 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-19T17:36:18.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=51539607555 2026-02-19T17:36:18.372 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-19T17:36:18.372 INFO:tasks.workunit.client.0.trial119.stdout:waiting osd.0 seq 51539607555 2026-02-19T17:36:18.372 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:36:18.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 51539607555 2026-02-19T17:36:18.594 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:36:19.595 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-19T17:36:19.595 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:36:19.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 51539607555 2026-02-19T17:36:19.816 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-19T17:36:20.817 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-19T17:36:20.817 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-19T17:36:21.038 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-19T17:36:21.038 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-19T17:36:21.039 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:36:21.039 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:36:21.321 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-19T17:36:21.321 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-19T17:36:21.321 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-19T17:36:21.321 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-19T17:36:21.321 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-19T17:36:21.322 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-19T17:36:21.322 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-19T17:36:21.322 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-19T17:36:21.532 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-19T17:36:21.533 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-19T17:36:21.533 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-19T17:36:21.533 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-19T17:36:21.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-19T17:36:21.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-19T17:36:21.814 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-19T17:36:21.815 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-19T17:36:21.815 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-19T17:36:21.899 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: total_space_after=4294967296 2026-02-19T17:36:21.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-19T17:36:21.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-19T17:36:21.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep free 2026-02-19T17:36:21.900 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d: -f 2 2026-02-19T17:36:21.901 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d, -f 1 2026-02-19T17:36:21.901 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-19T17:36:21.980 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: free_space_after=2848260096 2026-02-19T17:36:21.981 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:470: TEST_bluestore_expand: '[' 4294967296 '!=' 4294967296 ']' 2026-02-19T17:36:21.981 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:476: TEST_bluestore_expand: total_space_added=0 2026-02-19T17:36:21.981 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:477: TEST_bluestore_expand: free_space_added=-26132480 2026-02-19T17:36:21.981 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:479: TEST_bluestore_expand: let 'new_used_space=(0 - -26132480)' 2026-02-19T17:36:21.981 INFO:tasks.workunit.client.0.trial119.stdout:26132480 2026-02-19T17:36:21.982 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:480: TEST_bluestore_expand: echo 26132480 2026-02-19T17:36:21.982 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:482: TEST_bluestore_expand: '[' 26132480 -gt 131072 ']' 2026-02-19T17:36:21.982 INFO:tasks.workunit.client.0.trial119.stdout:total_space_added = 0 2026-02-19T17:36:21.982 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:483: TEST_bluestore_expand: echo 'total_space_added = 0' 2026-02-19T17:36:21.983 INFO:tasks.workunit.client.0.trial119.stdout:free_space_added = -26132480 2026-02-19T17:36:21.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:484: TEST_bluestore_expand: echo 'free_space_added = -26132480' 2026-02-19T17:36:21.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:485: TEST_bluestore_expand: return 1 2026-02-19T17:36:21.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-19T17:36:21.984 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: main: code=1 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bluefs-volume-ops 1 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-19T17:36:21.985 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-19T17:36:22.088 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-19T17:36:22.089 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-19T17:36:22.090 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-19T17:36:22.090 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-19T17:36:22.091 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-19T17:36:22.092 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-19T17:36:22.092 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-19T17:36:22.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:36:22.093 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-19T17:36:22.094 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-19T17:36:22.094 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T17:36:22.095 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:36:22.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2026-02-19T17:36:22.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-19T17:36:22.096 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-19T17:36:22.097 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/bluestore_tool.log td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log /home/ubuntu/cephtest/archive/log 2026-02-19T17:36:22.098 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-19T17:36:22.156 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-19T17:36:22.156 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-19T17:36:22.156 INFO:tasks.workunit.client.0.trial119.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.88022 2026-02-19T17:36:22.156 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.88022 2026-02-19T17:36:22.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-19T17:36:22.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-19T17:36:22.157 INFO:tasks.workunit.client.0.trial119.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 1 2026-02-19T17:36:22.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T17:36:22.159 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-19T17:36:22.159 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-19T17:36:22.485 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_802bf111cd55e57f5842153d7ba2b8b964aa818a/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_802bf111cd55e57f5842153d7ba2b8b964aa818a/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_802bf111cd55e57f5842153d7ba2b8b964aa818a/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-19T17:36:22.490 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-19T17:36:22.502 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-19T17:36:22.502 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-19T17:36:22.607 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-19T17:36:22.618 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-19T17:36:22.618 DEBUG:teuthology.orchestra.run.trial119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T17:36:22.683 INFO:teuthology.orchestra.run.trial119.stdout: remote refid st t when poll reach delay offset jitter 2026-02-19T17:36:22.683 INFO:teuthology.orchestra.run.trial119.stdout:============================================================================== 2026-02-19T17:36:22.683 INFO:teuthology.orchestra.run.trial119.stdout:*24-229-44-105-s .GPS. 1 u 55 64 377 20.101 +3.766 5.808 2026-02-19T17:36:22.684 INFO:teuthology.orchestra.run.trial119.stdout:+time-east.far.n 17.253.2.35 2 u 53 128 377 3.327 +10.166 1.226 2026-02-19T17:36:22.684 INFO:teuthology.orchestra.run.trial119.stdout:-smtp.brandonenr 132.239.1.6 2 u 51 128 377 79.073 +10.125 1.262 2026-02-19T17:36:22.684 INFO:teuthology.orchestra.run.trial119.stdout:+ntp1.glypnod.co 169.229.128.134 2 u 65 64 377 67.075 +9.442 1.242 2026-02-19T17:36:22.684 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-19T17:36:22.696 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-19T17:36:22.696 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-19T17:36:22.710 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-19T17:36:22.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-19T17:36:22.739 INFO:teuthology.task.internal:Duration was 1588.235410 seconds 2026-02-19T17:36:22.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-19T17:36:22.755 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-19T17:36:22.755 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-19T17:36:22.779 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-19T17:36:22.779 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial119.front.sepia.ceph.com 2026-02-19T17:36:22.780 DEBUG:teuthology.orchestra.run.trial119:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-19T17:36:22.832 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-19T17:36:22.833 DEBUG:teuthology.orchestra.run.trial119:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T17:36:23.094 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-19T17:36:23.094 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T17:36:23.102 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T17:36:23.104 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T17:36:23.104 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-19T17:36:23.104 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T17:36:23.104 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-19T17:36:23.170 INFO:teuthology.orchestra.run.trial119.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-19T17:36:23.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-19T17:36:23.188 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-19T17:36:23.188 DEBUG:teuthology.orchestra.run.trial119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-19T17:36:23.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-19T17:36:23.238 DEBUG:teuthology.orchestra.run.trial119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:36:23.274 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = core 2026-02-19T17:36:23.283 DEBUG:teuthology.orchestra.run.trial119:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-19T17:36:23.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T17:36:23.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-19T17:36:23.348 INFO:teuthology.task.internal:Transferring archived files... 2026-02-19T17:36:23.350 DEBUG:teuthology.misc:Transferring archived files from trial119:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-19_15:38:40-rados-wip-yuri-testing-2026-02-18-1820-distro-default-trial/59215/remote/trial119 2026-02-19T17:36:23.351 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-19T18:24:29.692 INFO:teuthology.task.internal:Removing archive directory... 2026-02-19T18:24:29.704 DEBUG:teuthology.orchestra.run.trial119:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-19T18:24:33.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-19T18:24:33.269 INFO:teuthology.task.internal:Not uploading archives. 2026-02-19T18:24:33.269 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-19T18:24:33.283 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-19T18:24:33.283 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-19T18:24:33.288 INFO:teuthology.orchestra.run.trial119.stdout: 1179687 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 19 18:24 /home/ubuntu/cephtest 2026-02-19T18:24:33.289 INFO:teuthology.orchestra.run.trial119.stdout: 1189864 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 19 17:13 /home/ubuntu/cephtest/mnt.0 2026-02-19T18:24:33.289 INFO:teuthology.orchestra.run.trial119.stdout: 1189865 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 19 17:23 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-19T18:24:33.289 INFO:teuthology.orchestra.run.trial119.stdout: 1205792 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 19 17:23 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-19T18:24:33.289 INFO:teuthology.orchestra.run.trial119.stdout: 1205793 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 19 17:36 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-19T18:24:33.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T18:24:33.290 INFO:teuthology.orchestra.run.trial119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-19T18:24:33.290 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial119 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-19T18:24:33.293 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-19T18:24:33.307 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-19T18:24:33.318 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial119 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-19T18:24:33.323 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 1588.2354102134705 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial119 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=802bf111cd55e57f5842153d7ba2b8b964aa818a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-19T18:24:33.323 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T18:24:33.411 INFO:teuthology.run:FAIL